Nov 04 05:48:30.828143 ip-10-0-143-195 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 05:48:31.257267 ip-10-0-143-195 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:48:31.257267 ip-10-0-143-195 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 05:48:31.257267 ip-10-0-143-195 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:48:31.257267 ip-10-0-143-195 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:48:31.261878 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261803    2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:48:31.261878 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261878    2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261896    2568 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261899    2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261902    2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261905    2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261908    2568 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261911    2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261913    2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261916    2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261919    2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261921    2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261924    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261926    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261929    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261931    2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261934    2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261937    2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261939    2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261942    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261944    2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:48:31.261959 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261947    2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261949    2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261951    2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261954    2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261957    2568 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261961    2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261967    2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261970    2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261974    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261977    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261979    2568 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261982    2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261984    2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261987    2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261989    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261992    2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261994    2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261996    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.261999    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262001    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:48:31.262408 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262004    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262007    2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262010    2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262012    2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262015    2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262018    2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262020    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262022    2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262025    2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262027    2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262030    2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262032    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262035    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262038    2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262040    2568 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262043    2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262046    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262048    2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262051    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262054    2568 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:48:31.262870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262056    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262059    2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262061    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262064    2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262066    2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262069    2568 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262071    2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262073    2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262076    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262078    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262081    2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262083    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262085    2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262088    2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262090    2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262093    2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262095    2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262098    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262100    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:48:31.263335 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262102    2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262106    2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262111    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262114    2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262116    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262119    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262121    2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262124    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262127    2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262129    2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262132    2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262134    2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262136    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262139    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262142    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262144    2568 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262147    2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262149    2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262152    2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:48:31.263765 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262154    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262157    2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262160    2568 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262162    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262165    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262167    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262170    2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262901    2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262908    2568 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262911    2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262913    2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262916    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262919    2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262921    2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262924    2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262927    2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262930    2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262932    2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262935    2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:48:31.264216 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262937    2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262940    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262943    2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262945    2568 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262948    2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262950    2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262953    2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262955    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262959    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262962    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262965    2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262969    2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262973    2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262976    2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262979    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262982    2568 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262984    2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262987    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262989    2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262992    2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:48:31.264656 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262994    2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262997    2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.262999    2568 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263002    2568 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263004    2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263007    2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263010    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263012    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263015    2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263018    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263020    2568 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263023    2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263025    2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263029    2568 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263031    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263034    2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263036    2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263039    2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263041    2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263043    2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:48:31.265132 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263046    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263049    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263052    2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263054    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263056    2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263059    2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263061    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263064    2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263067    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263069    2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263071    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263074    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263077    2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263080    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263082    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263084    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263087    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263089    2568 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263092    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263094    2568 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:48:31.265584 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263096    2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263099    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263101    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263104    2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263107    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263109    2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263112    2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263114    2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263117    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263119    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263122    2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263124    2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263127    2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263129    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263132    2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263135    2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263137    2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263141    2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263144    2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:48:31.266055 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263148    2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263150    2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263153    2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263155    2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263157    2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263160    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263162    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263165    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263167    2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263171    2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263173    2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263176    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263178    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263180    2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.263183    2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264783    2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264790    2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264793    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264796    2568 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264798    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:48:31.266504 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264801    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264804    2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264806    2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264809    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264812    2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264814    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264817    2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264820    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264822    2568 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264825    2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264828    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264830    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264836    2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264838    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264841    2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264843    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264846    2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264848    2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264851    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264854    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:48:31.266969 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264856    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264859    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264861    2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264864    2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264866    2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264868    2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264871    2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264873    2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264876    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264878    2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264895    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264898    2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264900    2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264903    2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264905    2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264908    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264910    2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264913    2568 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264915    2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:48:31.267464 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264917    2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264920    2568 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264923    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264926    2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264929    2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264932    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264935    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264937    2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264940    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264944    2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264947    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264950    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264953    2568 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264956    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264959    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264961    2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264964    2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264966    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264969    2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:48:31.267896 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264972    2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264974    2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264976    2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264979    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264981    2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264984    2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264987    2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264989    2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264992    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264994    2568 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264997    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.264999    2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265002    2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265005    2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265007    2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265013    2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265015    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265018    2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265022    2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265024    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:48:31.268330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265028    2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265032    2568 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265035    2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265038    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265041    2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265043    2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265046    2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265049    2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265051    2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265054    2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265057    2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265060    2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265063    2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265066    2568 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265068    2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265071    2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265074    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265077    2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265079    2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265081    2568 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:48:31.268871 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265084    2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265086    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265088    2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265175    2568 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265184    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265194    2568 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265200    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265207    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265213    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265218    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265223    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265226    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265229    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265232    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265235    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265238    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265241    2568 flags.go:64] FLAG: --cgroup-root=""
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265243    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265246    2568 flags.go:64] FLAG: --client-ca-file=""
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265249    2568 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265251    2568 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265255    2568 flags.go:64] FLAG: --cluster-domain=""
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265258    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 05:48:31.269348 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265261    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265264    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265267    2568 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265271    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265273    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265276    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265279    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265282    2568 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265285    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265288    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265291    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265293    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265297    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265300    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265303    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265306    2568 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265309    2568 flags.go:64] FLAG: --enable-server="true"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265312    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265321    2568 flags.go:64] FLAG: --event-burst="100"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265324    2568 flags.go:64] FLAG: --event-qps="50"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265327    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265330    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265332    2568 flags.go:64] FLAG: --eviction-hard=""
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265336    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 05:48:31.269872 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265339    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265342    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265345    2568 flags.go:64] FLAG: --eviction-soft=""
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265348    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265351    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265354    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265356    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265359    2568 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265362    2568 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265364    2568 flags.go:64] FLAG: --feature-gates=""
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265368    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265371    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265374    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265377    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265380    2568 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265383    2568 flags.go:64] FLAG: --help="false"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265385    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265388    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265391    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265394    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265397    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265400    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265411    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 05:48:31.270444 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265414    2568 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265417    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265425    2568 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265430    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265438    2568 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265441    2568 flags.go:64] FLAG: --kube-reserved=""
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265444    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265447    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265450    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265452    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265455    2568 flags.go:64] FLAG: --lock-file=""
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265458    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265461    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265464    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265469    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265471    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265474    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265477    2568 flags.go:64] FLAG: --logging-format="text"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265480    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265483    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265485    2568 flags.go:64] FLAG: --manifest-url=""
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265488    2568 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265496    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265499    2568 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265503    2568 flags.go:64] FLAG: --max-pods="110"
Nov 04 05:48:31.270990 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265506    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265508    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265511    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265514    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265516    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265519    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265522    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265528    2568 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265531    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265534    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265538    2568 flags.go:64] FLAG: --pod-cidr=""
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265541    2568 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265549    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265552    2568 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265555    2568 flags.go:64] FLAG: --port="10250"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265558    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265560    2568 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0b0044cefcbaf8d4f"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265563    2568 flags.go:64] FLAG: --qos-reserved=""
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265566    2568 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265569    2568 flags.go:64] FLAG: --register-node="true"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265572    2568 flags.go:64] FLAG: --register-with-taints=""
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265575    2568 flags.go:64] FLAG: --registry-burst="10"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265578    2568 flags.go:64] FLAG: --registry-qps="5"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265580    2568 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265583    2568 flags.go:64] FLAG: --reserved-memory=""
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265587    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 05:48:31.271563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265590    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265593    2568 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265596    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265599    2568 flags.go:64] FLAG: --runonce="false"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265601    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265604    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265607    2568 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265610    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265612    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265615    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265618    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265621    2568 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265625    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265628    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265630    2568 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265633    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265637    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265640    2568 flags.go:64] FLAG: --system-cgroups=""
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265642    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265653    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265656    2568 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265659    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265663    2568 flags.go:64] FLAG: --tls-min-version=""
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265665    2568 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265668    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 05:48:31.272201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265671    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265673    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265676    2568 flags.go:64] FLAG: --v="2"
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265680    2568 flags.go:64] FLAG: --version="false"
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265684    2568 flags.go:64] FLAG: --vmodule=""
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265688    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.265691    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265863    2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265866    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265869    2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265872    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265874    2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265877    2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265880    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265895    2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265898    2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265900    2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265903    2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265906    2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265910    2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:48:31.272956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265912    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265915    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265917    2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265921    2568 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265924    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265926    2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265929    2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265938    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265941    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265943    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265946    2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265948    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265950    2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265953    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265955    2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265958    2568 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265960    2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265963    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265965    2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265968    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:48:31.273671 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265970    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265972    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265975    2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265977    2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265980    2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265982    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265985    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265987    2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265989    2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265992    2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265994    2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.265999    2568 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266001    2568 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266004    2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266006    2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266010    2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266012    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266015    2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266017    2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266020    2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:48:31.274247 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266027    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266030    2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266033    2568 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266035    2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266037    2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266040    2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266042    2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266045    2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266047    2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266050    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266052    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266055    2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266057    2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266060    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266063    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266065    2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266068    2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266071    2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266073    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:48:31.274688 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266075    2568 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266078    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266080    2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266082    2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266086    2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266089    2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266091    2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266094    2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266097    2568 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266100    2568 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266102    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266105    2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266108    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266112    2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266121    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266124    2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266127    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266131    2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266134    2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:48:31.275128 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266137    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266139    2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266142    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266144    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266147    2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266149    2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266152    2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266154    2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266157    2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266159    2568 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266162    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266164    2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266166    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266169    2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266171    2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.266197    2568 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:48:31.275559 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266237    2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266241    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266247    2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266250    2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266252    2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266256    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266258    2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266261    2568 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266263    2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266265    2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266268    2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266271    2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266279    2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266281    2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266284    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266287    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266289    2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266291    2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266294    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:48:31.275947 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266297    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266299    2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266302    2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266304    2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266306    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266309    2568 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266311    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266313    2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266316    2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266318    2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266321    2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266323    2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266326    2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266328    2568 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266331    2568 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266334    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266337    2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266339    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266344    2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:48:31.276389 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266348    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266351    2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266354    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266358    2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266361    2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266363    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266366    2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266370    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266372    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266375    2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266377    2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266380    2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266382    2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266385    2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266387    2568 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266403    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266407    2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266410    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266413    2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:48:31.276814 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266416    2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266418    2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266421    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266423    2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266426    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266428    2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266431    2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266434    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266436    2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266440    2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266443    2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266445    2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266449    2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266452    2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266454    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266457    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266459    2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266462    2568 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266464    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:48:31.277260 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266466    2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266469    2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266472    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266474    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266478    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266480    2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266483    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266485    2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266487    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266490    2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266493    2568 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266495    2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266497    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266500    2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266502    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266505    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266508    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266510    2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266513    2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:48:31.277693 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266515    2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266518    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266521    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266525    2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266527    2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266529    2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266532    2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266535    2568 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266537    2568 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266540    2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.266542    2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.274274    2568 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.274291    2568 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.274306    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.274310    2568 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274367    2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274372    2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274375    2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274378    2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274381    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:48:31.278244 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274384    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274386    2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274389    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274392    2568 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274394    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274397    2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274400    2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274402    2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274405    2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274415    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274418    2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274421    2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274423    2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274426    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274429    2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274431    2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274434    2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274436    2568 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274439    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:48:31.278703 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274441    2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274444    2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274447    2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274450    2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274452    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274455    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274458    2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274460    2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274463    2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274466    2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274468    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274471    2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274473    2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274476    2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274478    2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274480    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274483    2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274485    2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274488    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:48:31.279243 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274490    2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274493    2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274495    2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274499    2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274502    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274504    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274507    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274509    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274512    2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274514    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274516    2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274520    2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274524    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274527    2568 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274529    2568 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274532    2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274535    2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274537    2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274540    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:48:31.279681 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274543    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274545    2568 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274548    2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274550    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274553    2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274555    2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274557    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274560    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274563    2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274565    2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274568    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274570    2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274572    2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274575    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274577    2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274580    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274582    2568 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274585    2568 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274588    2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274591    2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:48:31.280124 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274593    2568 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274595    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274598    2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274601    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274603    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274607    2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274611    2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274615    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274618    2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274621    2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274624    2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274626    2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274629    2568 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274632    2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274634    2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274637    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274639    2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274643    2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274645    2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274648    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:48:31.280573 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274651    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274653    2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274656    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274658    2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.274686    2568 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274826    2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274831    2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274834    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274837    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274839    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274843    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274845    2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274848    2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274851    2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274854    2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274856    2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:48:31.281065 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274859    2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274862    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274864    2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274867    2568 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274869    2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274871    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274874    2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274878    2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274899    2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274904    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274906    2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274909    2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274911    2568 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274914    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274917    2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274919    2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274922    2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274926    2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274929    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:48:31.281432 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274932    2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274935    2568 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274938    2568 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274940    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274943    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274946    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274949    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274951    2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274954    2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274957    2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274960    2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274962    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274965    2568 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274967    2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274970    2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274972    2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274975    2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274977    2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274980    2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274982    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:48:31.281870 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274984    2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274987    2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274990    2568 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274992    2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274995    2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.274997    2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275000    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275002    2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275005    2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275007    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275009    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275012    2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275015    2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275017    2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275020    2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275022    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275025    2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275027    2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275029    2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:48:31.282460 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275032    2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275034    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275037    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275039    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275042    2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275044    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275047    2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275050    2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275052    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275055    2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275057    2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275059    2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275062    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275064    2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275067    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275069    2568 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275072    2568 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275074    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275076    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275079    2568 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:48:31.282873 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275081    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275084    2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275086    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275089    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275091    2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275094    2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275096    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275099    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275101    2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275104    2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275106    2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275109    2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275111    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275114    2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275116    2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275119    2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:48:31.283330 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275121    2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.275145    2568 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275176    2568 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275180    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275183    2568 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275185    2568 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275188    2568 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275190    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275193    2568 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275196    2568 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275198    2568 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275202    2568 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275205    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275208    2568 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275211    2568 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275214    2568 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:48:31.283698 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275218    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275220    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275223    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275225    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275227    2568 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275230    2568 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275233    2568 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275235    2568 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275238    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275240    2568 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275243    2568 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275245    2568 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275248    2568 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275250    2568 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275253    2568 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275255    2568 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275258    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275261    2568 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275263    2568 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275266    2568 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:48:31.284073 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275269    2568 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275271    2568 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275292    2568 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275295    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275298    2568 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275300    2568 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275303    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275306    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275308    2568 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275313    2568 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275315    2568 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275319    2568 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275321    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275324    2568 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275326    2568 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275329    2568 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275331    2568 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275334    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275336    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:48:31.284532 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275339    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275341    2568 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275343    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275346    2568 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275349    2568 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275351    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275354    2568 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275357    2568 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275359    2568 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275362    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275365    2568 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275367    2568 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275370    2568 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275372    2568 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275374    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275377    2568 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275379    2568 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275381    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275384    2568 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275386    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:48:31.284963 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275389    2568 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275391    2568 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275396    2568 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275398    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275401    2568 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275403    2568 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275409    2568 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275412    2568 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275414    2568 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275417    2568 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275419    2568 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275422    2568 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275424    2568 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275427    2568 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275429    2568 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275432    2568 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275434    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275437    2568 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275439    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:48:31.285420 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275442    2568 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275444    2568 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275447    2568 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275449    2568 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275456    2568 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275459    2568 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275461    2568 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275464    2568 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275466    2568 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275468    2568 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275471    2568 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275473    2568 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275475    2568 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:31.275480    2568 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.275535    2568 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.277729    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.278663    2568 server.go:1014] "Starting client certificate rotation"
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.278764    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:48:31.285867 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.278795    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:48:31.286309 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.280825    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:48:31.286309 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.282161    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:48:31.296281 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.296264    2568 log.go:25] "Validated CRI v1 runtime API"
Nov 04 05:48:31.299838 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.299825    2568 log.go:25] "Validated CRI v1 image API"
Nov 04 05:48:31.300650 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.300630    2568 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 05:48:31.304765 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.304742    2568 fs.go:135] Filesystem UUIDs: map[13806b24-130a-4854-8105-8d5af4a634c6:/dev/nvme0n1p4 322e2992-a8ad-40c9-bf14-b7a256d898b7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Nov 04 05:48:31.304809 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.304765    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 05:48:31.311732 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.311628    2568 manager.go:217] Machine: {Timestamp:2026-11-04 05:48:31.309963238 +0000 UTC m=+0.359643012 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201830 MemoryCapacity:32812023808 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec213e62afd56d7a470839f13e865acb SystemUUID:ec213e62-afd5-6d7a-4708-39f13e865acb BootID:3feef2a6-ad32-4899-90a6-b38b5b2dc05b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406011904 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:8a:df:27:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:8a:df:27:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:fb:f6:4a:c3:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812023808 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 05:48:31.311732 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.311730    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 05:48:31.311838 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.311797    2568 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 05:48:31.314939 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.314917    2568 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 05:48:31.315059 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.314940    2568 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-195.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 05:48:31.315106 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.315062    2568 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 05:48:31.315106 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.315070    2568 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 05:48:31.315156 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.315110    2568 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:48:31.315156 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.315131    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:48:31.316121 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.316110    2568 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 05:48:31.319196 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.319184    2568 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 05:48:31.319315 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.319305    2568 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 05:48:31.320048 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.320039    2568 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 05:48:31.320076 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.320051    2568 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 05:48:31.320076 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.320061    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 05:48:31.320076 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.320069    2568 kubelet.go:405] "Adding apiserver pod source"
Nov 04 05:48:31.320076 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.320077    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 05:48:31.320466 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.320439    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:48:31.324357 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.324335    2568 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 05:48:31.331040 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.331028    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:48:31.331998 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.331986    2568 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 05:48:31.332035 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332015    2568 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 05:48:31.332158 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332147    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 05:48:31.332191 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332162    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 05:48:31.332191 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332169    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 05:48:31.332191 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332174    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 05:48:31.332191 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332179    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 05:48:31.332191 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332184    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 05:48:31.332802 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332794    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 05:48:31.332802 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332802    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 05:48:31.332858 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332809    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 05:48:31.332858 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332815    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 05:48:31.332858 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332822    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 05:48:31.332858 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.332834    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 05:48:31.335021 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.335012    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 05:48:31.335021 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.335021    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 05:48:31.339167 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.339151    2568 server.go:1263] "Started kubelet"
Nov 04 05:48:31.339253 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.339221    2568 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 05:48:31.339318 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.339240    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 05:48:31.339318 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.339300    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 05:48:31.339802 ip-10-0-143-195 systemd[1]: Started Kubernetes Kubelet.
Nov 04 05:48:31.340805 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.340792    2568 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 05:48:31.341305 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.341292    2568 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 05:48:31.345247 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.345229    2568 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 05:48:31.347548 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.347529    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 05:48:31.348701 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.348688    2568 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 05:48:31.348830 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.348783    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:31.349372 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.349357    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 05:48:31.349372 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.349361    2568 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 05:48:31.349507 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.349393    2568 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 05:48:31.349558 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.349530    2568 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 05:48:31.349558 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.349540    2568 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 05:48:31.349979 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.349956    2568 factory.go:153] Registering CRI-O factory
Nov 04 05:48:31.349979 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.349974    2568 factory.go:223] Registration of the crio container factory successfully
Nov 04 05:48:31.350099 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.350015    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 05:48:31.350099 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.350025    2568 factory.go:55] Registering systemd factory
Nov 04 05:48:31.350099 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.350033    2568 factory.go:223] Registration of the systemd container factory successfully
Nov 04 05:48:31.350099 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.350049    2568 factory.go:103] Registering Raw factory
Nov 04 05:48:31.350099 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.350059    2568 manager.go:1199] Started watching for new ooms in manager
Nov 04 05:48:31.351128 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.351112    2568 manager.go:319] Starting recovery of all containers
Nov 04 05:48:31.361007 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.360965    2568 manager.go:324] Recovery completed
Nov 04 05:48:31.363357 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.363328    2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Nov 04 05:48:31.366045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.366002    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:31.367599 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.367572    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:31.367664 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.367609    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:31.367664 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.367619    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:31.368105 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.368093    2568 cpu_manager.go:226] "Starting" policy="none"
Nov 04 05:48:31.368105 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.368102    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:31.368218 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.368104    2568 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 05:48:31.368218 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.368143    2568 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 05:48:31.368775 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.368760    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:31.368848 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.368788    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:31.368848 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.368802    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:31.369428 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.369368    2568 policy_none.go:50] "Start"
Nov 04 05:48:31.369478 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.369458    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 05:48:31.369478 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.369472    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 05:48:31.370517 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.370505    2568 policy_none.go:44] "Start"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.409465    2568 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.411915    2568 manager.go:341] "Starting Device Plugin manager"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.411936    2568 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.411943    2568 server.go:87] "Starting device plugin registration server"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.412124    2568 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.412134    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.412239    2568 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.412319    2568 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.412329    2568 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.413014    2568 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 05:48:31.417719 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.413070    2568 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:31.421614 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.421594    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 05:48:31.422815 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.422801    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 05:48:31.422897 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.422821    2568 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 05:48:31.422897 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.422838    2568 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 05:48:31.422897 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.422866    2568 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 04 05:48:31.490700 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.490511    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-195.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 05:48:31.490789 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.490536    2568 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-195.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 04 05:48:31.491628 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.490556    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-195.us-west-1.compute.internal.18e4c180fca7c1e2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-195.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-195.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 05:48:31.339127266 +0000 UTC m=+0.388807041,LastTimestamp:2026-11-04 05:48:31.339127266 +0000 UTC m=+0.388807041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-195.us-west-1.compute.internal,}"
Nov 04 05:48:31.513108 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.513066    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:31.513905 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.513876    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:31.513961 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.513916    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:31.513961 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.513927    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:31.513961 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.513948    2568 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.524166 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.524146    2568 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"]
Nov 04 05:48:31.524224 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.524203    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:31.525044 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.525027    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:31.525115 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.525054    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:31.525115 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.525063    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:31.526171 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526160    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:31.526307 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526292    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.526355 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526321    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:31.526903 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526873    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:31.526978 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526918    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:31.526978 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526923    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:31.526978 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526947    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:31.526978 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526959    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:31.527107 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.526928    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:31.528311 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.528298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.528374 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.528330    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:31.528989 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.528974    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:31.529059 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.529006    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:31.529059 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.529016    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:31.551236 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.551215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.551314 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.551238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.551314 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.551263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c656c4baa8463ac8d24886e04ca99821-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"c656c4baa8463ac8d24886e04ca99821\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.552496 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.552478    2568 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.555801 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.555783    2568 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.570819 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.570805    2568 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 05:48:31.570903 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.570839    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kklrv"
Nov 04 05:48:31.599999 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.599972    2568 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass"
Nov 04 05:48:31.599999 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.599981    2568 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 04 05:48:31.600089 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.599986    2568 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-195.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 04 05:48:31.600089 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.599981    2568 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 04 05:48:31.651404 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.651377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.651460 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.651408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.651460 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.651424    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c656c4baa8463ac8d24886e04ca99821-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"c656c4baa8463ac8d24886e04ca99821\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.651460 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.651448    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c656c4baa8463ac8d24886e04ca99821-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"c656c4baa8463ac8d24886e04ca99821\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.651542 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.651465    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.651542 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.651475    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.653053 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.652984    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-195.us-west-1.compute.internal.18e4c180fe5a2ade  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-195.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-195.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-195.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 05:48:31.367596766 +0000 UTC m=+0.417276540,LastTimestamp:2026-11-04 05:48:31.367596766 +0000 UTC m=+0.417276540,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-195.us-west-1.compute.internal,}"
Nov 04 05:48:31.659677 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.659660    2568 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-195.us-west-1.compute.internal\" not found" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.800444 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.800398    2568 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-195.us-west-1.compute.internal\" not found" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.856864 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.856847    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.860928 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.860659    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:31.860928 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.860703    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.861413 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.861396    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:31.861468 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.861427    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:31.861468 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.861440    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:31.861468 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.861465    2568 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.921424 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:31.921403    2568 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:31.921502 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:31.921432    2568 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-195.us-west-1.compute.internal\": node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.041788 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.041764    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.142621 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.142575    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.242965 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.242945    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.278293 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.278273    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 05:48:32.278696 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.278395    2568 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ad99878772f894bf595fb87a43495684-6faf233d34787b2e.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-143-195.us-west-1.compute.internal.18e4c180fe5a9238\": read tcp 10.0.143.195:40338->18.223.64.73:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-143-195.us-west-1.compute.internal.18e4c180fe5a9238  default   4896 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-195.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-195.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-195.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 05:48:31 +0000 UTC,LastTimestamp:2026-11-04 05:48:31.51393081 +0000 UTC m=+0.563610584,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-195.us-west-1.compute.internal,}"
Nov 04 05:48:32.343773 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.343746    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.444390 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.444346    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.545366 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.545345    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.574446 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.574420    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:43:32 +0000 UTC" deadline="2028-07-19 20:46:18.366747554 +0000 UTC"
Nov 04 05:48:32.574446 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.574443    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14966h57m45.792307612s"
Nov 04 05:48:32.646158 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.646141    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.657604 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.657585    2568 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:48:32.658442 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.658429    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:48:32.658502 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.658457    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:48:32.658502 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.658468    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:48:32.746284 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.746233    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.820880 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.820856    2568 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:48:32.846966 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.846939    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:32.928956 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:32.928922    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc656c4baa8463ac8d24886e04ca99821.slice/crio-5bcbb5877bf8814c731412d596b75feee7ab8df7a4c6b8f0ec27a7ebc4c3155c WatchSource:0}: Error finding container 5bcbb5877bf8814c731412d596b75feee7ab8df7a4c6b8f0ec27a7ebc4c3155c: Status 404 returned error can't find the container with id 5bcbb5877bf8814c731412d596b75feee7ab8df7a4c6b8f0ec27a7ebc4c3155c
Nov 04 05:48:32.929168 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:32.929149    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac965f1cfbc1129016d728e686326ed6.slice/crio-037598b14878d232c87a82d475474a0024c1503a7c9b21d4377684721c914bec WatchSource:0}: Error finding container 037598b14878d232c87a82d475474a0024c1503a7c9b21d4377684721c914bec: Status 404 returned error can't find the container with id 037598b14878d232c87a82d475474a0024c1503a7c9b21d4377684721c914bec
Nov 04 05:48:32.934587 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:32.934572    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:48:32.947419 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:32.947386    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:33.009986 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.009933    2568 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:48:33.047965 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.047947    2568 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:48:33.061546 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.061530    2568 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:48:33.133038 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.133021    2568 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:48:33.148843 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.148824    2568 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:33.212338 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.212322    2568 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:48:33.213438 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.213426    2568 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:48:33.278720 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.278676    2568 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:48:33.320935 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.320920    2568 apiserver.go:52] "Watching apiserver"
Nov 04 05:48:33.348085 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.348068    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 05:48:33.427215 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.427166    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"c656c4baa8463ac8d24886e04ca99821","Type":"ContainerStarted","Data":"5bcbb5877bf8814c731412d596b75feee7ab8df7a4c6b8f0ec27a7ebc4c3155c"}
Nov 04 05:48:33.428152 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.428124    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"ac965f1cfbc1129016d728e686326ed6","Type":"ContainerStarted","Data":"037598b14878d232c87a82d475474a0024c1503a7c9b21d4377684721c914bec"}
Nov 04 05:48:33.435473 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.435454    2568 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 05:48:33.435754 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.435739    2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-86xkr","openshift-cluster-node-tuning-operator/tuned-wqr99","openshift-multus/multus-additional-cni-plugins-4f5z8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8","openshift-ovn-kubernetes/ovnkube-node-q4fh2","kube-system/konnectivity-agent-mkw6n","kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal","openshift-image-registry/node-ca-mzv2m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal","openshift-multus/multus-jcnwk","openshift-dns/node-resolver-gclqh","openshift-multus/network-metrics-daemon-8jl2j","openshift-network-diagnostics/network-check-target-x4mpr","openshift-network-operator/iptables-alerter-xzhzv"]
Nov 04 05:48:33.437638 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.437624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.438653 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.438634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:33.438732 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.438686    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:33.439643 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.439627    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.440744 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.440729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.442103 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.442085    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.443360 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.443344    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:33.444475 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.444461    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.445729 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.445716    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.447018 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.447002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.448253 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.448238    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.448322 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.448287    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:33.449747 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.449728    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.451034 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.451019    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:33.451091 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.451076    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:33.461658 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.461632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-k8s-cni-cncf-io\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.461753 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.461679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-bin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.461753 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.461744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-daemon-config\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.461852 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.461782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-node-log\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.461852 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.461823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.462014 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.461867    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-script-lib\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.462014 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.461922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cnibin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.462108 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.461995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-config\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.462108 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-systemd\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.462108 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-run\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.462108 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7pd\" (UniqueName: \"kubernetes.io/projected/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-kube-api-access-fr7pd\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.462291 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462116    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-registration-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.462291 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462136    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-systemd-units\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.462291 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-ovn\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.462291 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462289    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-var-lib-kubelet\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.462457 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462304    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-hosts-file\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.462457 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-tmp-dir\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.462457 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462366    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-system-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.462457 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-netns\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.462457 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462406    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-multus\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.462457 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-binary-copy\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-host\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-tmp\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462529    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxtcr\" (UniqueName: \"kubernetes.io/projected/5e10d4d3-40d6-4020-b19e-a72fecf919bc-kube-api-access-jxtcr\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462547    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cni-binary-copy\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-conf-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-etc-kubernetes\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462609    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-socket-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462635    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462653    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4wpn\" (UniqueName: \"kubernetes.io/projected/f0d57b8d-62e0-4e04-af9f-4006db8324f7-kube-api-access-s4wpn\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462671    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-var-lib-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-kubelet-config\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.462702 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462707    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6v4r\" (UniqueName: \"kubernetes.io/projected/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-kube-api-access-b6v4r\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-system-cni-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462818    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-log-socket\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-env-overrides\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-modprobe-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462871    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkjh\" (UniqueName: \"kubernetes.io/projected/cd63c0ac-166d-4805-9cce-2759db31106d-kube-api-access-qzkjh\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462913    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-multus-certs\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462933    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-kubelet\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462947    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.462966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovn-node-metrics-cert\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk9lz\" (UniqueName: \"kubernetes.io/projected/e49a7b69-154b-44a8-b678-ee31d9bda0de-kube-api-access-rk9lz\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463037    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-kubelet\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-netns\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1365fa77-d96f-45c6-be2e-fa85586ee67a-iptables-alerter-script\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.463259 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swzq4\" (UniqueName: \"kubernetes.io/projected/1365fa77-d96f-45c6-be2e-fa85586ee67a-kube-api-access-swzq4\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-lib-modules\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-hostroot\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463175    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-sys-fs\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-systemd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463212    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-netd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/960698a0-8d7a-4451-bb9a-3da528e49130-host\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463246    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/960698a0-8d7a-4451-bb9a-3da528e49130-serviceca\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463265    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-conf\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-socket-dir-parent\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463435    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysconfig\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.463991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463478    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2nb\" (UniqueName: \"kubernetes.io/projected/e7816f19-a486-4310-810e-3c8fdaf82f81-kube-api-access-7p2nb\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463496    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-bin\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463513    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463539    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-konnectivity-ca\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463569    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-cnibin\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463601    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-device-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-slash\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463689    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-etc-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-kubernetes\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463769    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-sys\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463801    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-tuned\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463828    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1365fa77-d96f-45c6-be2e-fa85586ee67a-host-slash\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkbmm\" (UniqueName: \"kubernetes.io/projected/960698a0-8d7a-4451-bb9a-3da528e49130-kube-api-access-wkbmm\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463913    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-dbus\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.464576 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.463985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-agent-certs\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:33.495977 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.495957    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 05:48:33.495977 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.495958    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 05:48:33.496088 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.495979    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 05:48:33.496088 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.495967    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-tk5dx\""
Nov 04 05:48:33.496088 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.495963    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 05:48:33.497229 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.497217    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 05:48:33.497330 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.497318    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 05:48:33.497508 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.497494    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7wx5\""
Nov 04 05:48:33.498256 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.498242    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 05:48:33.498256 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.498243    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 05:48:33.498456 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.498443    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8frb\""
Nov 04 05:48:33.498529 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.498516    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 05:48:33.499796 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.499778    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 05:48:33.499871 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.499859    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 05:48:33.500022 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.500010    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 05:48:33.500273 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.500250    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 05:48:33.500317 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.500261    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qt7t9\""
Nov 04 05:48:33.500317 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.500261    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 05:48:33.500317 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.500292    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 05:48:33.500832 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.500818    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 05:48:33.501066 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.501055    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 05:48:33.501185 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.501173    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-plv46\""
Nov 04 05:48:33.501959 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.501946    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 05:48:33.519303 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519282    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 05:48:33.519446 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519434    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-njggn\""
Nov 04 05:48:33.519492 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519480    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 05:48:33.519543 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519529    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mrpf\""
Nov 04 05:48:33.519629 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519612    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 05:48:33.519685 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519619    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lflbx\""
Nov 04 05:48:33.519734 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519697    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5jcm9\""
Nov 04 05:48:33.519734 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519710    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 05:48:33.519815 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519731    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 05:48:33.519815 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519738    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:48:33.519924 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.519911    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 05:48:33.520033 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.520021    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 05:48:33.520071 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.520024    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:48:33.551073 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.551020    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 05:48:33.557477 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.557456    2568 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 05:48:33.557564 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.557545    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6fw8l"
Nov 04 05:48:33.564720 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-cnibin\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.564822 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.564822 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-device-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.564822 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564778    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-slash\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.564822 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564799    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-cnibin\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-etc-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564834    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-device-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564847    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-kubernetes\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564876    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-kubernetes\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-sys\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564909    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564914    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-slash\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-tuned\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564943    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-sys\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1365fa77-d96f-45c6-be2e-fa85586ee67a-host-slash\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564904    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-etc-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.564974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkbmm\" (UniqueName: \"kubernetes.io/projected/960698a0-8d7a-4451-bb9a-3da528e49130-kube-api-access-wkbmm\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565016    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1365fa77-d96f-45c6-be2e-fa85586ee67a-host-slash\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.565045 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565027    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-dbus\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565065    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-agent-certs\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-k8s-cni-cncf-io\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-bin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-daemon-config\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-node-log\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565172    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-k8s-cni-cncf-io\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565196    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-bin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565214    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-dbus\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565217    2568 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565250    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-node-log\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565285    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-script-lib\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cnibin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565329    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-config\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565373    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-systemd\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565388    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cnibin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.565623 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565395    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-run\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7pd\" (UniqueName: \"kubernetes.io/projected/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-kube-api-access-fr7pd\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565443    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-systemd\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565476    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-registration-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565502    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-run\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565536    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-systemd-units\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565545    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-registration-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-systemd-units\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565580    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-ovn\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565605    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-var-lib-kubelet\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-hosts-file\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565647    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-tmp-dir\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565668    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-system-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565712    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-var-lib-kubelet\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-netns\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-multus\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565757    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-ovn\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565791    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-hosts-file\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.566499 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565789    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-multus\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-binary-copy\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565826    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-daemon-config\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565845    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565876    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-host\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565919    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-tmp\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565908    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-host\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565958    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-script-lib\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxtcr\" (UniqueName: \"kubernetes.io/projected/5e10d4d3-40d6-4020-b19e-a72fecf919bc-kube-api-access-jxtcr\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.565995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cni-binary-copy\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-conf-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-etc-kubernetes\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-socket-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566077    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-config\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566102    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-tmp-dir\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566181    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-system-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566207    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-netns\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.567263 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566248    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-etc-kubernetes\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566275    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-conf-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4wpn\" (UniqueName: \"kubernetes.io/projected/f0d57b8d-62e0-4e04-af9f-4006db8324f7-kube-api-access-s4wpn\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566581    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-var-lib-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566609    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-kubelet-config\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6v4r\" (UniqueName: \"kubernetes.io/projected/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-kube-api-access-b6v4r\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-system-cni-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566719    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-var-lib-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566770    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-log-socket\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566810    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-log-socket\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566828    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-env-overrides\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566868    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-kubelet-config\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566936    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-modprobe-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.566994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkjh\" (UniqueName: \"kubernetes.io/projected/cd63c0ac-166d-4805-9cce-2759db31106d-kube-api-access-qzkjh\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567035    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-multus-certs\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567145    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-socket-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.568170 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567201    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-multus-certs\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567244    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-modprobe-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567262    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-kubelet\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567311    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567319    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovn-node-metrics-cert\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567442    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-system-cni-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567493    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567530    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk9lz\" (UniqueName: \"kubernetes.io/projected/e49a7b69-154b-44a8-b678-ee31d9bda0de-kube-api-access-rk9lz\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567574    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-kubelet\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567662    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-kubelet\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-netns\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1365fa77-d96f-45c6-be2e-fa85586ee67a-iptables-alerter-script\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567778    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swzq4\" (UniqueName: \"kubernetes.io/projected/1365fa77-d96f-45c6-be2e-fa85586ee67a-kube-api-access-swzq4\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-lib-modules\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567874    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:33.569025 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567895    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-kubelet\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-hostroot\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-sys-fs\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.567985    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568009    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-lib-modules\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568055    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-netns\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568126    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-systemd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568169    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-netd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568137    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-sys-fs\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/960698a0-8d7a-4451-bb9a-3da528e49130-host\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/960698a0-8d7a-4451-bb9a-3da528e49130-serviceca\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568314    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-conf\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568369    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-socket-dir-parent\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568495    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-systemd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.569828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568574    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysconfig\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2nb\" (UniqueName: \"kubernetes.io/projected/e7816f19-a486-4310-810e-3c8fdaf82f81-kube-api-access-7p2nb\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-bin\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568648    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568745    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-netd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568757    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1365fa77-d96f-45c6-be2e-fa85586ee67a-iptables-alerter-script\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568772    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysconfig\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568806    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-socket-dir-parent\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.568898    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568866    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568957    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-hostroot\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.568994    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:34.068947166 +0000 UTC m=+3.118626963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569103    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-conf\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.569177    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.569228    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret podName:4d26948e-8d34-4cd2-bfe6-0702f4965c1b nodeName:}" failed. No retries permitted until 2026-11-04 05:48:34.069213289 +0000 UTC m=+3.118893071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret") pod "global-pull-secret-syncer-86xkr" (UID: "4d26948e-8d34-4cd2-bfe6-0702f4965c1b") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569296    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/960698a0-8d7a-4451-bb9a-3da528e49130-host\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.570453 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569473    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569469    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/960698a0-8d7a-4451-bb9a-3da528e49130-serviceca\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569496    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-konnectivity-ca\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569531    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.568907    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-bin\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569635    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-agent-certs\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569670    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-tmp\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569760    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-tuned\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569885    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovn-node-metrics-cert\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.569968    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.570000    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cni-binary-copy\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.570629    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-binary-copy\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.570750    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-konnectivity-ca\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:33.570936 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.570795    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-env-overrides\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.635440 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.635410    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:48:33.635440 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.635439    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:48:33.635560 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.635451    2568 projected.go:196] Error preparing data for projected volume kube-api-access-d5wfm for pod openshift-network-diagnostics/network-check-target-x4mpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:33.635560 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:33.635505    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm podName:8ca4017d-de12-4d9f-be61-b1a5aeaea9ef nodeName:}" failed. No retries permitted until 2026-11-04 05:48:34.135490112 +0000 UTC m=+3.185169893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d5wfm" (UniqueName: "kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm") pod "network-check-target-x4mpr" (UID: "8ca4017d-de12-4d9f-be61-b1a5aeaea9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:33.638446 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.638415    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkbmm\" (UniqueName: \"kubernetes.io/projected/960698a0-8d7a-4451-bb9a-3da528e49130-kube-api-access-wkbmm\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.638555 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.638459    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7pd\" (UniqueName: \"kubernetes.io/projected/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-kube-api-access-fr7pd\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.639415 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.639389    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxtcr\" (UniqueName: \"kubernetes.io/projected/5e10d4d3-40d6-4020-b19e-a72fecf919bc-kube-api-access-jxtcr\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.639592 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.639569    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6v4r\" (UniqueName: \"kubernetes.io/projected/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-kube-api-access-b6v4r\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:33.640012 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.639988    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4wpn\" (UniqueName: \"kubernetes.io/projected/f0d57b8d-62e0-4e04-af9f-4006db8324f7-kube-api-access-s4wpn\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.640129 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.640108    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkjh\" (UniqueName: \"kubernetes.io/projected/cd63c0ac-166d-4805-9cce-2759db31106d-kube-api-access-qzkjh\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.640266 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.640242    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swzq4\" (UniqueName: \"kubernetes.io/projected/1365fa77-d96f-45c6-be2e-fa85586ee67a-kube-api-access-swzq4\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.640359 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.640343    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk9lz\" (UniqueName: \"kubernetes.io/projected/e49a7b69-154b-44a8-b678-ee31d9bda0de-kube-api-access-rk9lz\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.640756 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.640735    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2nb\" (UniqueName: \"kubernetes.io/projected/e7816f19-a486-4310-810e-3c8fdaf82f81-kube-api-access-7p2nb\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.748898 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.748864    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jcnwk"
Nov 04 05:48:33.758440 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:33.758419    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d57b8d_62e0_4e04_af9f_4006db8324f7.slice/crio-3f0655dad32a25b03be2f07d3d67e1a599261553d9175b3432d5586ba011a3b1 WatchSource:0}: Error finding container 3f0655dad32a25b03be2f07d3d67e1a599261553d9175b3432d5586ba011a3b1: Status 404 returned error can't find the container with id 3f0655dad32a25b03be2f07d3d67e1a599261553d9175b3432d5586ba011a3b1
Nov 04 05:48:33.759450 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.759430    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:48:33.763843 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.763826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:48:33.767632 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:33.767610    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd63c0ac_166d_4805_9cce_2759db31106d.slice/crio-e9194a1abff28c086f0aaab6b8d5ff64b8a8767126bb3e22bdfd5e9a2a9e4d32 WatchSource:0}: Error finding container e9194a1abff28c086f0aaab6b8d5ff64b8a8767126bb3e22bdfd5e9a2a9e4d32: Status 404 returned error can't find the container with id e9194a1abff28c086f0aaab6b8d5ff64b8a8767126bb3e22bdfd5e9a2a9e4d32
Nov 04 05:48:33.774363 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.774321    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:33.775225 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.775200    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:33.779049 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.779030    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:48:33.783759 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:33.783638    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49a7b69_154b_44a8_b678_ee31d9bda0de.slice/crio-888b7cefe688285471279c5c7557408a200fa06783e3eeaf74d898d3069a4727 WatchSource:0}: Error finding container 888b7cefe688285471279c5c7557408a200fa06783e3eeaf74d898d3069a4727: Status 404 returned error can't find the container with id 888b7cefe688285471279c5c7557408a200fa06783e3eeaf74d898d3069a4727
Nov 04 05:48:33.784306 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.784285    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:48:33.786768 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:33.786749    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b61b57_97fa_42cd_a376_cd9d9d78eeaa.slice/crio-afd00ea868af33eccfacc78bb6e1de5f93305ba6960d464ad23d775633953d4e WatchSource:0}: Error finding container afd00ea868af33eccfacc78bb6e1de5f93305ba6960d464ad23d775633953d4e: Status 404 returned error can't find the container with id afd00ea868af33eccfacc78bb6e1de5f93305ba6960d464ad23d775633953d4e
Nov 04 05:48:33.789773 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.789755    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:48:33.790045 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:33.790024    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1365fa77_d96f_45c6_be2e_fa85586ee67a.slice/crio-62da034aef86751f5bbff871dbd53556b1b56510df2ad20aad674145c9fcad9b WatchSource:0}: Error finding container 62da034aef86751f5bbff871dbd53556b1b56510df2ad20aad674145c9fcad9b: Status 404 returned error can't find the container with id 62da034aef86751f5bbff871dbd53556b1b56510df2ad20aad674145c9fcad9b
Nov 04 05:48:33.794191 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:33.794171    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:48:33.794536 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:33.794508    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960698a0_8d7a_4451_bb9a_3da528e49130.slice/crio-b02f32240459905faa07ecd15f0d385ef84f23f848da3f0fd7b2c70f9462f38f WatchSource:0}: Error finding container b02f32240459905faa07ecd15f0d385ef84f23f848da3f0fd7b2c70f9462f38f: Status 404 returned error can't find the container with id b02f32240459905faa07ecd15f0d385ef84f23f848da3f0fd7b2c70f9462f38f
Nov 04 05:48:33.798745 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:33.798726    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e10d4d3_40d6_4020_b19e_a72fecf919bc.slice/crio-f6d67031d26fc3d963e5a53b6ac4d6d59d3ee8dfe5dcaaa62e0b2a51c3459a33 WatchSource:0}: Error finding container f6d67031d26fc3d963e5a53b6ac4d6d59d3ee8dfe5dcaaa62e0b2a51c3459a33: Status 404 returned error can't find the container with id f6d67031d26fc3d963e5a53b6ac4d6d59d3ee8dfe5dcaaa62e0b2a51c3459a33
Nov 04 05:48:33.803743 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:48:33.803723    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8138b678_e6cc_4bb6_9ab6_5b26e8963b25.slice/crio-1829d5c80bc965c146fe05760658b02f0943cf6056767784d8b115eadd0b7779 WatchSource:0}: Error finding container 1829d5c80bc965c146fe05760658b02f0943cf6056767784d8b115eadd0b7779: Status 404 returned error can't find the container with id 1829d5c80bc965c146fe05760658b02f0943cf6056767784d8b115eadd0b7779
Nov 04 05:48:34.073460 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.073376    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:34.073460 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.073427    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:34.073672 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:34.073508    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:34.073672 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:34.073543    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:34.073672 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:34.073581    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret podName:4d26948e-8d34-4cd2-bfe6-0702f4965c1b nodeName:}" failed. No retries permitted until 2026-11-04 05:48:35.073559086 +0000 UTC m=+4.123238869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret") pod "global-pull-secret-syncer-86xkr" (UID: "4d26948e-8d34-4cd2-bfe6-0702f4965c1b") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:34.073672 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:34.073602    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:35.073591531 +0000 UTC m=+4.123271324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:34.174224 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.174186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:34.174411 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:34.174387    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:48:34.174411 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:34.174409    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:48:34.174533 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:34.174418    2568 projected.go:196] Error preparing data for projected volume kube-api-access-d5wfm for pod openshift-network-diagnostics/network-check-target-x4mpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:34.174533 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:34.174475    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm podName:8ca4017d-de12-4d9f-be61-b1a5aeaea9ef nodeName:}" failed. No retries permitted until 2026-11-04 05:48:35.174460353 +0000 UTC m=+4.224140130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5wfm" (UniqueName: "kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm") pod "network-check-target-x4mpr" (UID: "8ca4017d-de12-4d9f-be61-b1a5aeaea9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:34.431771 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.431674    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wqr99" event={"ID":"5e10d4d3-40d6-4020-b19e-a72fecf919bc","Type":"ContainerStarted","Data":"f6d67031d26fc3d963e5a53b6ac4d6d59d3ee8dfe5dcaaa62e0b2a51c3459a33"}
Nov 04 05:48:34.433601 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.433570    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzhzv" event={"ID":"1365fa77-d96f-45c6-be2e-fa85586ee67a","Type":"ContainerStarted","Data":"62da034aef86751f5bbff871dbd53556b1b56510df2ad20aad674145c9fcad9b"}
Nov 04 05:48:34.434991 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.434962    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gclqh" event={"ID":"8138b678-e6cc-4bb6-9ab6-5b26e8963b25","Type":"ContainerStarted","Data":"1829d5c80bc965c146fe05760658b02f0943cf6056767784d8b115eadd0b7779"}
Nov 04 05:48:34.436458 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.436409    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mzv2m" event={"ID":"960698a0-8d7a-4451-bb9a-3da528e49130","Type":"ContainerStarted","Data":"b02f32240459905faa07ecd15f0d385ef84f23f848da3f0fd7b2c70f9462f38f"}
Nov 04 05:48:34.437843 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.437817    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mkw6n" event={"ID":"84b61b57-97fa-42cd-a376-cd9d9d78eeaa","Type":"ContainerStarted","Data":"afd00ea868af33eccfacc78bb6e1de5f93305ba6960d464ad23d775633953d4e"}
Nov 04 05:48:34.439201 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.439179    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"888b7cefe688285471279c5c7557408a200fa06783e3eeaf74d898d3069a4727"}
Nov 04 05:48:34.440749 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.440723    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8" event={"ID":"e7816f19-a486-4310-810e-3c8fdaf82f81","Type":"ContainerStarted","Data":"df747e1eee46b064ca13ffd6348ddbe96fd4016538a9da89dead656429ddf262"}
Nov 04 05:48:34.442305 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.442277    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" event={"ID":"cd63c0ac-166d-4805-9cce-2759db31106d","Type":"ContainerStarted","Data":"e9194a1abff28c086f0aaab6b8d5ff64b8a8767126bb3e22bdfd5e9a2a9e4d32"}
Nov 04 05:48:34.443679 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.443654    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jcnwk" event={"ID":"f0d57b8d-62e0-4e04-af9f-4006db8324f7","Type":"ContainerStarted","Data":"3f0655dad32a25b03be2f07d3d67e1a599261553d9175b3432d5586ba011a3b1"}
Nov 04 05:48:34.560323 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.560275    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:34 +0000 UTC" deadline="2028-05-18 01:22:56.256357575 +0000 UTC"
Nov 04 05:48:34.560323 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:34.560317    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13459h34m21.696045654s"
Nov 04 05:48:35.084292 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:35.084255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:35.084461 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:35.084306    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:35.084461 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.084429    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:35.084564 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.084499    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:37.084475167 +0000 UTC m=+6.134154934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:35.084648 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.084566    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:35.084648 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.084602    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret podName:4d26948e-8d34-4cd2-bfe6-0702f4965c1b nodeName:}" failed. No retries permitted until 2026-11-04 05:48:37.084590881 +0000 UTC m=+6.134270660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret") pod "global-pull-secret-syncer-86xkr" (UID: "4d26948e-8d34-4cd2-bfe6-0702f4965c1b") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:35.185088 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:35.184989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:35.185245 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.185171    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:48:35.185245 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.185195    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:48:35.185245 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.185209    2568 projected.go:196] Error preparing data for projected volume kube-api-access-d5wfm for pod openshift-network-diagnostics/network-check-target-x4mpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:35.185417 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.185277    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm podName:8ca4017d-de12-4d9f-be61-b1a5aeaea9ef nodeName:}" failed. No retries permitted until 2026-11-04 05:48:37.185257893 +0000 UTC m=+6.234937683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5wfm" (UniqueName: "kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm") pod "network-check-target-x4mpr" (UID: "8ca4017d-de12-4d9f-be61-b1a5aeaea9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:35.429609 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:35.429156    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:35.429609 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.429308    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:35.429609 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:35.429430    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:35.429609 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.429537    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:35.429951 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:35.429680    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:35.429951 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:35.429801    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:35.560577 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:35.560456    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:34 +0000 UTC" deadline="2028-08-03 01:42:17.8074939 +0000 UTC"
Nov 04 05:48:35.560577 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:35.560518    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15307h53m42.24697979s"
Nov 04 05:48:36.469016 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:36.468528    2568 generic.go:356] "Generic (PLEG): container finished" podID="ac965f1cfbc1129016d728e686326ed6" containerID="e9ed2406ed18c0a13c01d82899d426678c88d12285c60b4de7e0e486ede02d36" exitCode=0
Nov 04 05:48:36.469016 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:36.468583    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"ac965f1cfbc1129016d728e686326ed6","Type":"ContainerDied","Data":"e9ed2406ed18c0a13c01d82899d426678c88d12285c60b4de7e0e486ede02d36"}
Nov 04 05:48:37.097651 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.097607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:37.098239 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.097669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:37.098239 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.097843    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:37.098239 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.097909    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:41.097889742 +0000 UTC m=+10.147569523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:37.098239 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.098007    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:37.098239 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.098049    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret podName:4d26948e-8d34-4cd2-bfe6-0702f4965c1b nodeName:}" failed. No retries permitted until 2026-11-04 05:48:41.098036462 +0000 UTC m=+10.147716229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret") pod "global-pull-secret-syncer-86xkr" (UID: "4d26948e-8d34-4cd2-bfe6-0702f4965c1b") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:37.198267 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.198227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:37.198603 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.198405    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:48:37.198673 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.198622    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:48:37.198673 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.198638    2568 projected.go:196] Error preparing data for projected volume kube-api-access-d5wfm for pod openshift-network-diagnostics/network-check-target-x4mpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:37.198780 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.198701    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm podName:8ca4017d-de12-4d9f-be61-b1a5aeaea9ef nodeName:}" failed. No retries permitted until 2026-11-04 05:48:41.198683124 +0000 UTC m=+10.248362893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5wfm" (UniqueName: "kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm") pod "network-check-target-x4mpr" (UID: "8ca4017d-de12-4d9f-be61-b1a5aeaea9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:37.425094 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.425065    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:37.425227 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.425206    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:37.425309 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.425279    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:37.425374 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.425354    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:37.425512 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.425494    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:37.425600 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:37.425584    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:37.474127 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.474093    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"ac965f1cfbc1129016d728e686326ed6","Type":"ContainerStarted","Data":"b83ed686a3781fccb52aaf733d253cff8ed104418425efe5a12e83b999cd5818"}
Nov 04 05:48:37.479370 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.478942    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"c656c4baa8463ac8d24886e04ca99821","Type":"ContainerStarted","Data":"66a2cd44ba76d8cc16f8b31975ba514f1e0b07ba245d181fbe360ab9b398d23b"}
Nov 04 05:48:37.748372 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.747137    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal" podStartSLOduration=4.747114307 podStartE2EDuration="4.747114307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:37.61214118 +0000 UTC m=+6.661820967" watchObservedRunningTime="2026-11-04 05:48:37.747114307 +0000 UTC m=+6.796794128"
Nov 04 05:48:37.748372 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:37.748190    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal" podStartSLOduration=4.748178815 podStartE2EDuration="4.748178815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:37.747218694 +0000 UTC m=+6.796898483" watchObservedRunningTime="2026-11-04 05:48:37.748178815 +0000 UTC m=+6.797858603"
Nov 04 05:48:38.518877 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:38.518844    2568 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="63cd5caddd9aeec4424b023342fe2ff48f88e28b5246801e54d041ca242c6780" exitCode=0
Nov 04 05:48:38.519892 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:38.519856    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" event={"ID":"cd63c0ac-166d-4805-9cce-2759db31106d","Type":"ContainerDied","Data":"63cd5caddd9aeec4424b023342fe2ff48f88e28b5246801e54d041ca242c6780"}
Nov 04 05:48:39.426484 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:39.426148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:39.426484 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:39.426253    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:39.426484 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:39.426316    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:39.426484 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:39.426362    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:39.426484 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:39.426405    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:39.426484 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:39.426452    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:39.525244 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:39.524596    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mkw6n" event={"ID":"84b61b57-97fa-42cd-a376-cd9d9d78eeaa","Type":"ContainerStarted","Data":"7b6991a1d731e67c6ef4f9d143aab5b5bad5336d5e24a3f0b3f2bce8ed5a66db"}
Nov 04 05:48:39.662271 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:39.662212    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mkw6n" podStartSLOduration=2.936525682 podStartE2EDuration="7.662192003s" totalImagesPullingTime="4.725666321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:39.661771606 +0000 UTC m=+8.711451393" watchObservedRunningTime="2026-11-04 05:48:39.662192003 +0000 UTC m=+8.711871795"
Nov 04 05:48:39.945524 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:39.945098    2568 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:39.945729 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:39.945643    2568 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:48:40.532657 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:40.532550    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mzv2m" event={"ID":"960698a0-8d7a-4451-bb9a-3da528e49130","Type":"ContainerStarted","Data":"e40b852694d12ae0c45a8cb86c9fba8368d6d91d8c1de31b6216098ea9397b76"}
Nov 04 05:48:40.537618 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:40.537589    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8" event={"ID":"e7816f19-a486-4310-810e-3c8fdaf82f81","Type":"ContainerStarted","Data":"be5d0374f2918a70ccbf9c250c2b49301380dab70f1477e1628411c705086e75"}
Nov 04 05:48:41.132723 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:41.132303    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:41.132723 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:41.132357    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:41.132723 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.132518    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:41.132723 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.132590    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:49.132570754 +0000 UTC m=+18.182250522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:41.132723 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.132659    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:41.132723 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.132692    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret podName:4d26948e-8d34-4cd2-bfe6-0702f4965c1b nodeName:}" failed. No retries permitted until 2026-11-04 05:48:49.132684728 +0000 UTC m=+18.182364493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret") pod "global-pull-secret-syncer-86xkr" (UID: "4d26948e-8d34-4cd2-bfe6-0702f4965c1b") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:41.233707 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:41.233354    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:41.233707 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.233560    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:48:41.233707 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.233584    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:48:41.233707 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.233598    2568 projected.go:196] Error preparing data for projected volume kube-api-access-d5wfm for pod openshift-network-diagnostics/network-check-target-x4mpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:41.233707 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.233666    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm podName:8ca4017d-de12-4d9f-be61-b1a5aeaea9ef nodeName:}" failed. No retries permitted until 2026-11-04 05:48:49.233644465 +0000 UTC m=+18.283324234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5wfm" (UniqueName: "kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm") pod "network-check-target-x4mpr" (UID: "8ca4017d-de12-4d9f-be61-b1a5aeaea9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:41.434512 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:41.432100    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:41.434512 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.432273    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:41.434512 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:41.434262    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:41.434512 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.434408    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:41.435834 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:41.435084    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:41.435834 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:41.435249    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:41.539907 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:41.538923    2568 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:48:42.493956 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:42.493912    2568 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 05:48:42.544179 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:42.544147    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8" event={"ID":"e7816f19-a486-4310-810e-3c8fdaf82f81","Type":"ContainerStarted","Data":"5425da9783c34259a4b1c112fa9e7d68de889c2991058000e4af65ed4f7abf7c"}
Nov 04 05:48:42.549283 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:42.546978    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jcnwk" event={"ID":"f0d57b8d-62e0-4e04-af9f-4006db8324f7","Type":"ContainerStarted","Data":"88f39aca1f9b44621ebf7afa8a2a83e64dba4c43bb23def077b9ff0726e9ce8a"}
Nov 04 05:48:42.677013 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:42.676956    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mzv2m" podStartSLOduration=5.009896584 podStartE2EDuration="10.676940689s" totalImagesPullingTime="5.667044105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:40.670668964 +0000 UTC m=+9.720348752" watchObservedRunningTime="2026-11-04 05:48:42.676940689 +0000 UTC m=+11.726620472"
Nov 04 05:48:42.677158 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:42.677081    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-jcnwk" podStartSLOduration=2.105326692 podStartE2EDuration="10.677076992s" totalImagesPullingTime="8.5717503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:42.676618897 +0000 UTC m=+11.726298707" watchObservedRunningTime="2026-11-04 05:48:42.677076992 +0000 UTC m=+11.726756787"
Nov 04 05:48:43.423564 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.423531    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:43.423696 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:43.423672    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:43.423795 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.423780    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:43.423920 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:43.423878    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:43.424016 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.423996    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:43.424116 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:43.424096    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:43.436297 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.436191    2568 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:48:42.493938697Z","UUID":"5541f776-afad-4669-a891-7f68922d3a5d","Handler":null,"Name":"","Endpoint":""}
Nov 04 05:48:43.438095 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.438073    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 05:48:43.438195 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.438123    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 05:48:43.551943 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.551911    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gclqh" event={"ID":"8138b678-e6cc-4bb6-9ab6-5b26e8963b25","Type":"ContainerStarted","Data":"f982769c019e541dae8e9a706b46153d04f32d60eea7011d0fb871e28b80732d"}
Nov 04 05:48:43.555138 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.555005    2568 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="7437e3603cf45c5fa2519a435d92d2e2dad235ddc20477c029912dcd2fc1133c" exitCode=0
Nov 04 05:48:43.555138 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.555087    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" event={"ID":"cd63c0ac-166d-4805-9cce-2759db31106d","Type":"ContainerDied","Data":"7437e3603cf45c5fa2519a435d92d2e2dad235ddc20477c029912dcd2fc1133c"}
Nov 04 05:48:43.677323 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:43.677048    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-gclqh" podStartSLOduration=3.139027972 podStartE2EDuration="11.677032396s" totalImagesPullingTime="8.538004424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:43.676754703 +0000 UTC m=+12.726434487" watchObservedRunningTime="2026-11-04 05:48:43.677032396 +0000 UTC m=+12.726712180"
Nov 04 05:48:44.558565 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:44.558535    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzhzv" event={"ID":"1365fa77-d96f-45c6-be2e-fa85586ee67a","Type":"ContainerStarted","Data":"ce517ea7e18de2438ad28cde7f2d4c4b6fab8ca2afed8dc214a4186d89c85e99"}
Nov 04 05:48:44.688318 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:44.688273    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzhzv" podStartSLOduration=3.840267566 podStartE2EDuration="12.688260165s" totalImagesPullingTime="8.847992599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:44.687041602 +0000 UTC m=+13.736721403" watchObservedRunningTime="2026-11-04 05:48:44.688260165 +0000 UTC m=+13.737939981"
Nov 04 05:48:45.423399 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.423367    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:45.423523 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.423396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:45.423523 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:45.423502    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:45.423619 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.423548    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:45.423666 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:45.423641    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:45.423749 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:45.423729    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:45.563462 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.563375    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8" event={"ID":"e7816f19-a486-4310-810e-3c8fdaf82f81","Type":"ContainerStarted","Data":"203fca15518859e35e4b02ff9ff5dd8ac290dea303b668e321a6509d04c1db51"}
Nov 04 05:48:45.565811 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.565776    2568 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="506e96fba4dede05a305511e7f5d5cd84e1f60ef6f93c5052a5196c39eb7e999" exitCode=0
Nov 04 05:48:45.566963 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.565811    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" event={"ID":"cd63c0ac-166d-4805-9cce-2759db31106d","Type":"ContainerDied","Data":"506e96fba4dede05a305511e7f5d5cd84e1f60ef6f93c5052a5196c39eb7e999"}
Nov 04 05:48:45.568324 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.568297    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wqr99" event={"ID":"5e10d4d3-40d6-4020-b19e-a72fecf919bc","Type":"ContainerStarted","Data":"3f8d9aa1d6d5eea71687282894e0aee0436076a1a49b2f2b3506dd46009c02c7"}
Nov 04 05:48:45.692028 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.691976    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8" podStartSLOduration=3.3456496 podStartE2EDuration="13.691958724s" totalImagesPullingTime="10.346309124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:45.691718375 +0000 UTC m=+14.741398160" watchObservedRunningTime="2026-11-04 05:48:45.691958724 +0000 UTC m=+14.741638509"
Nov 04 05:48:45.954321 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:45.954226    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wqr99" podStartSLOduration=2.869808446 podStartE2EDuration="13.95421233s" totalImagesPullingTime="11.084403884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:45.953980451 +0000 UTC m=+15.003660229" watchObservedRunningTime="2026-11-04 05:48:45.95421233 +0000 UTC m=+15.003892114"
Nov 04 05:48:47.423500 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:47.423274    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:47.424152 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:47.423343    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:47.424152 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:47.423567    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:47.424152 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:47.423601    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:47.424152 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:47.423356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:47.424152 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:47.423656    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:47.575677 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:47.575639    2568 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="260411c84a88821630efbee5bdc890f2a86fe8adba34e196ffefe4225448382f" exitCode=0
Nov 04 05:48:47.575839 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:47.575697    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" event={"ID":"cd63c0ac-166d-4805-9cce-2759db31106d","Type":"ContainerDied","Data":"260411c84a88821630efbee5bdc890f2a86fe8adba34e196ffefe4225448382f"}
Nov 04 05:48:49.193641 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.193614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:49.193980 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.193658    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:49.193980 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.193772    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:49.193980 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.193776    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:49.193980 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.193828    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:05.193811978 +0000 UTC m=+34.243491741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:48:49.193980 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.193841    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret podName:4d26948e-8d34-4cd2-bfe6-0702f4965c1b nodeName:}" failed. No retries permitted until 2026-11-04 05:49:05.193834866 +0000 UTC m=+34.243514628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret") pod "global-pull-secret-syncer-86xkr" (UID: "4d26948e-8d34-4cd2-bfe6-0702f4965c1b") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:48:49.295062 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.295031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:49.295197 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.295176    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:48:49.295197 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.295200    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:48:49.295328 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.295212    2568 projected.go:196] Error preparing data for projected volume kube-api-access-d5wfm for pod openshift-network-diagnostics/network-check-target-x4mpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:49.295328 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.295269    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm podName:8ca4017d-de12-4d9f-be61-b1a5aeaea9ef nodeName:}" failed. No retries permitted until 2026-11-04 05:49:05.295250678 +0000 UTC m=+34.344930460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5wfm" (UniqueName: "kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm") pod "network-check-target-x4mpr" (UID: "8ca4017d-de12-4d9f-be61-b1a5aeaea9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:48:49.423584 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.423558    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:49.423718 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.423693    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:49.423826 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.423774    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:49.423910 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.423859    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:49.424052 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.424030    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:49.424158 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:49.424136    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:49.584770 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.584549    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"f144f201862145611770cea71de3b4f2259e96c1cf0d808e812e6d230ae7b87f"}
Nov 04 05:48:49.584938 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.584830    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"df27b481c616902cf153a91255911ea435a9e91c616e82d9fcf6df5b2285a8f2"}
Nov 04 05:48:49.584938 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.584904    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"ba2eb7508565507c3c18dc4edfe10dc1f91e78c3561bb74d52f31d049fa6fc7d"}
Nov 04 05:48:49.585030 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.584952    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"9917d713580f5239f61d8469fdff033466ab4c6e02b0fa36bcdc445cde3c5463"}
Nov 04 05:48:49.585030 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.584997    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"db6060e70f47e3f89048292e709ca981b4dd3e9a6ac3a4030bde08e4aa470104"}
Nov 04 05:48:49.585093 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:49.585040    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"3a62a7246f19b0b8415720a2d910c2a6a9c4cda2321dd89e7525f8b011433f3e"}
Nov 04 05:48:50.588779 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:50.588748    2568 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="fe2de4996cbc60c4fb2062b26e31b837a6964c9c13f9932889d7d5137fb92017" exitCode=0
Nov 04 05:48:50.589346 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:50.588791    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" event={"ID":"cd63c0ac-166d-4805-9cce-2759db31106d","Type":"ContainerDied","Data":"fe2de4996cbc60c4fb2062b26e31b837a6964c9c13f9932889d7d5137fb92017"}
Nov 04 05:48:51.424509 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:51.424481    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:51.424662 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:51.424562    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:51.424662 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:51.424647    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:51.424764 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:51.424675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:51.424764 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:51.424741    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:51.424872 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:51.424837    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:51.594375 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:51.594347    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"1001a81c8add9a3580b46b5487a992d4960e481ce0cdc8d9c7d12790a5f6024d"}
Nov 04 05:48:51.597564 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:51.597540    2568 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="5ded7c1564db719ea83f5cb7694af694f4b6e1c17f231686bacb1663bc20c550" exitCode=0
Nov 04 05:48:51.597741 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:51.597581    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" event={"ID":"cd63c0ac-166d-4805-9cce-2759db31106d","Type":"ContainerDied","Data":"5ded7c1564db719ea83f5cb7694af694f4b6e1c17f231686bacb1663bc20c550"}
Nov 04 05:48:52.602416 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:52.602384    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" event={"ID":"cd63c0ac-166d-4805-9cce-2759db31106d","Type":"ContainerStarted","Data":"ccc9c2ea5ad25e2dab3578ada22bc4f3ea6a953174ecc499d23ff3c63278466d"}
Nov 04 05:48:52.735166 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:52.735128    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4f5z8" podStartSLOduration=7.407042788 podStartE2EDuration="20.735116399s" totalImagesPullingTime="13.328073611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:52.734397314 +0000 UTC m=+21.784077098" watchObservedRunningTime="2026-11-04 05:48:52.735116399 +0000 UTC m=+21.784796182"
Nov 04 05:48:53.423849 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:53.423822    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:53.424047 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:53.423964    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:53.424047 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:53.423973    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:53.424183 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:53.424064    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:53.424183 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:53.424120    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:53.424276 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:53.424197    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:54.609127 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:54.608959    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" event={"ID":"e49a7b69-154b-44a8-b678-ee31d9bda0de","Type":"ContainerStarted","Data":"950b9b4afc80d379e07c26ef3682b50317407587c55575bb8599f0d86741ec29"}
Nov 04 05:48:54.609849 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:54.609175    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:54.624831 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:54.624809    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:54.914979 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:54.914863    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2" podStartSLOduration=7.541204615 podStartE2EDuration="22.914848146s" totalImagesPullingTime="15.373643531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:54.858552683 +0000 UTC m=+23.908232473" watchObservedRunningTime="2026-11-04 05:48:54.914848146 +0000 UTC m=+23.964527930"
Nov 04 05:48:55.424033 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:55.424007    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:55.424185 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:55.424040    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:55.424185 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:55.424017    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:55.424185 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:55.424093    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:55.424348 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:55.424202    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:55.424348 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:55.424290    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:55.611062 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:55.611041    2568 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:48:55.611428 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:55.611412    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:55.626213 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:55.626195    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:48:56.335112 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:56.335038    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x4mpr"]
Nov 04 05:48:56.335261 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:56.335157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:56.335321 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:56.335264    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:48:56.338001 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:56.337975    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-86xkr"]
Nov 04 05:48:56.338106 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:56.338059    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:56.338190 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:56.338140    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:56.338489 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:56.338471    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8jl2j"]
Nov 04 05:48:56.338563 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:56.338553    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:56.338656 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:56.338628    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:56.613231 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:56.613175    2568 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:48:57.615568 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:57.615543    2568 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:48:58.423594 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:58.423569    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:48:58.423707 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:58.423600    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:48:58.423707 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:58.423694    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:48:58.423789 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:58.423766    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:48:58.423822 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:48:58.423810    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:48:58.423877 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:48:58.423858    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:49:00.107921 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.107879    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:00.108266 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.108102    2568 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:49:00.118858 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.118834    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:00.424006 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.423939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:00.424006 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.423948    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:00.424206 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:00.424025    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jl2j" podUID="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0"
Nov 04 05:49:00.424206 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.424077    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:00.424206 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:00.424165    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86xkr" podUID="4d26948e-8d34-4cd2-bfe6-0702f4965c1b"
Nov 04 05:49:00.424299 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:00.424221    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4mpr" podUID="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef"
Nov 04 05:49:00.587978 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.587951    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:49:00.588106 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.588060    2568 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:49:00.588477 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:00.588464    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:49:01.015135 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:01.015108    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:01.210684 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:01.210655    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:02.224784 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.224654    2568 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeReady"
Nov 04 05:49:02.225134 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.224863    2568 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 05:49:02.353516 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.353459    2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hlwlz"]
Nov 04 05:49:02.355036 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.355021    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:02.409267 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.409242    2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7m6nd"]
Nov 04 05:49:02.411631 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.411609    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hlwlz"]
Nov 04 05:49:02.411742 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.411642    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7m6nd"]
Nov 04 05:49:02.411742 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.411723    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.413319 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.413296    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 05:49:02.413319 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.413310    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 05:49:02.413456 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.413395    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 05:49:02.413456 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.413449    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rt5s6\""
Nov 04 05:49:02.423764 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.423737    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:02.423835 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.423816    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:02.423918 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.423906    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:02.490821 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.490799    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc242644-0d8b-4303-ab8f-a495cd324938-cert\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:02.490927 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.490829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2b2\" (UniqueName: \"kubernetes.io/projected/cf1a9959-1d76-4da9-b119-9fe97b9499d5-kube-api-access-gd2b2\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.490927 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.490863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.491021 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.490985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcqsh\" (UniqueName: \"kubernetes.io/projected/cc242644-0d8b-4303-ab8f-a495cd324938-kube-api-access-tcqsh\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:02.491054 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.491043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1a9959-1d76-4da9-b119-9fe97b9499d5-config-volume\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.491096 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.491060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1a9959-1d76-4da9-b119-9fe97b9499d5-tmp-dir\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.514495 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.514469    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 05:49:02.514590 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.514564    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 05:49:02.514746 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.514731    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwct4\""
Nov 04 05:49:02.514802 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.514762    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gcv4b\""
Nov 04 05:49:02.514802 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.514768    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 05:49:02.514874 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.514803    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv6vj\""
Nov 04 05:49:02.514874 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.514824    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 05:49:02.591505 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.591483    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc242644-0d8b-4303-ab8f-a495cd324938-cert\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:02.591582 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.591508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2b2\" (UniqueName: \"kubernetes.io/projected/cf1a9959-1d76-4da9-b119-9fe97b9499d5-kube-api-access-gd2b2\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.591582 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.591531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.591582 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.591549    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcqsh\" (UniqueName: \"kubernetes.io/projected/cc242644-0d8b-4303-ab8f-a495cd324938-kube-api-access-tcqsh\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:02.591680 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.591592    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1a9959-1d76-4da9-b119-9fe97b9499d5-config-volume\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.591680 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.591615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1a9959-1d76-4da9-b119-9fe97b9499d5-tmp-dir\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.591680 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:02.591641    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:02.591801 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:02.591692    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:03.091674806 +0000 UTC m=+32.141354584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:02.592026 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.592012    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1a9959-1d76-4da9-b119-9fe97b9499d5-tmp-dir\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.592204 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.592189    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1a9959-1d76-4da9-b119-9fe97b9499d5-config-volume\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.595276 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.595263    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc242644-0d8b-4303-ab8f-a495cd324938-cert\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:02.614443 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.614401    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 05:49:02.614508 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.614490    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 05:49:02.618690 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.618675    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mpd4s\""
Nov 04 05:49:02.644943 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.644915    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:02.658146 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.658126    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2b2\" (UniqueName: \"kubernetes.io/projected/cf1a9959-1d76-4da9-b119-9fe97b9499d5-kube-api-access-gd2b2\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:02.658146 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.658140    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcqsh\" (UniqueName: \"kubernetes.io/projected/cc242644-0d8b-4303-ab8f-a495cd324938-kube-api-access-tcqsh\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:02.663977 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.663957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:02.792397 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:02.792369    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:03.053334 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:03.053275    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hlwlz"]
Nov 04 05:49:03.058237 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:49:03.058212    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc242644_0d8b_4303_ab8f_a495cd324938.slice/crio-57e6a5652d09c184236c2f1d08a35acb7b0f6a08ff4a5807e9e4c7302fd1f23f WatchSource:0}: Error finding container 57e6a5652d09c184236c2f1d08a35acb7b0f6a08ff4a5807e9e4c7302fd1f23f: Status 404 returned error can't find the container with id 57e6a5652d09c184236c2f1d08a35acb7b0f6a08ff4a5807e9e4c7302fd1f23f
Nov 04 05:49:03.095833 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:03.095811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:03.095955 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:03.095942    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:03.095997 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:03.095992    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.095979297 +0000 UTC m=+33.145659060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:03.252202 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:03.252176    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:03.396128 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:03.396073    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:03.628977 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:03.628955    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hlwlz" event={"ID":"cc242644-0d8b-4303-ab8f-a495cd324938","Type":"ContainerStarted","Data":"57e6a5652d09c184236c2f1d08a35acb7b0f6a08ff4a5807e9e4c7302fd1f23f"}
Nov 04 05:49:04.102079 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:04.102032    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:04.102370 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:04.102177    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:04.102370 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:04.102258    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:06.102236894 +0000 UTC m=+35.151916672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:04.860076 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:04.860043    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:04.999148 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:04.999118    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:05.211855 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.211745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:05.211855 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.211830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:05.212092 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:05.211975    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 05:49:05.212092 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:05.212042    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:37.212024933 +0000 UTC m=+66.261704715 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : secret "metrics-daemon-secret" not found
Nov 04 05:49:05.214405 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.214383    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:05.313019 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.312980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:05.315866 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.315838    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:05.439511 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.439479    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:05.443629 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.443606    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:05.834023 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.834003    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-86xkr"]
Nov 04 05:49:05.868638 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:49:05.868612    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d26948e_8d34_4cd2_bfe6_0702f4965c1b.slice/crio-0c384b6b359fe7dc73522b68fb47150bc99f60d8c46ea9fa750799c315526568 WatchSource:0}: Error finding container 0c384b6b359fe7dc73522b68fb47150bc99f60d8c46ea9fa750799c315526568: Status 404 returned error can't find the container with id 0c384b6b359fe7dc73522b68fb47150bc99f60d8c46ea9fa750799c315526568
Nov 04 05:49:05.888833 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:05.888810    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x4mpr"]
Nov 04 05:49:05.890170 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:49:05.890141    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca4017d_de12_4d9f_be61_b1a5aeaea9ef.slice/crio-7e969e5805dd9141ab043a7710e01fe69474a7dcdf41d34b154460180776be81 WatchSource:0}: Error finding container 7e969e5805dd9141ab043a7710e01fe69474a7dcdf41d34b154460180776be81: Status 404 returned error can't find the container with id 7e969e5805dd9141ab043a7710e01fe69474a7dcdf41d34b154460180776be81
Nov 04 05:49:06.120514 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:06.120462    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:06.120626 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:06.120551    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:06.120626 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:06.120596    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:10.12058447 +0000 UTC m=+39.170264234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:06.334390 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:06.334357    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:06.482401 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:06.482331    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:06.636642 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:06.636605    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hlwlz" event={"ID":"cc242644-0d8b-4303-ab8f-a495cd324938","Type":"ContainerStarted","Data":"666718fd627b07645165bfbbefb3ce1f25f1ecb36f946382e54c25afa52aeaa2"}
Nov 04 05:49:06.637748 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:06.637725    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x4mpr" event={"ID":"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef","Type":"ContainerStarted","Data":"7e969e5805dd9141ab043a7710e01fe69474a7dcdf41d34b154460180776be81"}
Nov 04 05:49:06.638817 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:06.638797    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-86xkr" event={"ID":"4d26948e-8d34-4cd2-bfe6-0702f4965c1b","Type":"ContainerStarted","Data":"0c384b6b359fe7dc73522b68fb47150bc99f60d8c46ea9fa750799c315526568"}
Nov 04 05:49:06.763572 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:06.763508    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hlwlz" podStartSLOduration=1.663482519 podStartE2EDuration="4.763497666s" totalImagesPullingTime="3.100015147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:06.763444276 +0000 UTC m=+35.813124079" watchObservedRunningTime="2026-11-04 05:49:06.763497666 +0000 UTC m=+35.813177450"
Nov 04 05:49:08.097301 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.097269    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:08.251392 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.251355    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:08.393434 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.393349    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:08.542726 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.542694    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:08.639163 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.639133    2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hf4w8"]
Nov 04 05:49:08.692604 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.691735    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.695421 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.695386    2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"]
Nov 04 05:49:08.718206 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.718123    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:08.721000 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.720971    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hf4w8"]
Nov 04 05:49:08.721099 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.721067    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"
Nov 04 05:49:08.758591 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.758563    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"]
Nov 04 05:49:08.833624 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.833588    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 05:49:08.833785 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.833671    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 05:49:08.833785 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.833705    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 05:49:08.833785 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.833709    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 05:49:08.833785 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.833728    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 05:49:08.833785 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.833711    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8z5zb\""
Nov 04 05:49:08.833785 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.833712    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 05:49:08.833785 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.833750    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-58k5t\""
Nov 04 05:49:08.840134 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.840111    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0ce883-a723-48cc-a887-9c9db6942a43-data-volume\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.840265 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.840159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.840265 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.840229    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0ce883-a723-48cc-a887-9c9db6942a43-crio-socket\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.840265 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.840258    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.840404 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.840287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrg97\" (UniqueName: \"kubernetes.io/projected/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-api-access-zrg97\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.840404 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.840319    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt26d\" (UniqueName: \"kubernetes.io/projected/4dbb3142-eef1-4900-a295-d72dfb57eb90-kube-api-access-zt26d\") pod \"migrator-66df5d496b-cfsxx\" (UID: \"4dbb3142-eef1-4900-a295-d72dfb57eb90\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"
Nov 04 05:49:08.863649 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.863618    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:08.925795 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.925766    2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-smqxt-th6hc"]
Nov 04 05:49:08.941107 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.941075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0ce883-a723-48cc-a887-9c9db6942a43-crio-socket\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.941232 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.941122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.941232 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.941150    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrg97\" (UniqueName: \"kubernetes.io/projected/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-api-access-zrg97\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.941232 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.941179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt26d\" (UniqueName: \"kubernetes.io/projected/4dbb3142-eef1-4900-a295-d72dfb57eb90-kube-api-access-zt26d\") pod \"migrator-66df5d496b-cfsxx\" (UID: \"4dbb3142-eef1-4900-a295-d72dfb57eb90\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"
Nov 04 05:49:08.941232 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.941206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0ce883-a723-48cc-a887-9c9db6942a43-data-volume\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.941416 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:08.941263    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:08.941416 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:08.941324    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:09.441307239 +0000 UTC m=+38.490987025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:08.941515 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.941442    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0ce883-a723-48cc-a887-9c9db6942a43-data-volume\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.941515 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.941485    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0ce883-a723-48cc-a887-9c9db6942a43-crio-socket\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.941612 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.941594    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:08.941695 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:08.941680    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:49:08.941767 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:08.941724    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:09.441712786 +0000 UTC m=+38.491392561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : configmap "kube-rbac-proxy" not found
Nov 04 05:49:08.948850 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.948793    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:08.990381 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:08.990356    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-smqxt-th6hc"]
Nov 04 05:49:09.007274 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.007248    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 05:49:09.007382 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.007278    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dhhmg\""
Nov 04 05:49:09.009775 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.009754    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrg97\" (UniqueName: \"kubernetes.io/projected/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-api-access-zrg97\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:09.009977 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.009877    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt26d\" (UniqueName: \"kubernetes.io/projected/4dbb3142-eef1-4900-a295-d72dfb57eb90-kube-api-access-zt26d\") pod \"migrator-66df5d496b-cfsxx\" (UID: \"4dbb3142-eef1-4900-a295-d72dfb57eb90\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"
Nov 04 05:49:09.009977 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.009919    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:09.042615 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.042593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.042725 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.042646    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.042725 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.042683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jngrq\" (UniqueName: \"kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.042725 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.042714    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.064197 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.064175    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 05:49:09.077442 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.077418    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"
Nov 04 05:49:09.143651 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.143382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.143651 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.143434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jngrq\" (UniqueName: \"kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.143651 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.143469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.143651 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.143550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.144372 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.144011    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.144958 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.144593    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.144958 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.144647    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.211143 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.211082    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jngrq\" (UniqueName: \"kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.278508 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.278474    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:09.447424 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.446641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:09.447424 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.446720    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:09.447424 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:09.446807    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:49:09.447424 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:09.446871    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:10.446851874 +0000 UTC m=+39.496531640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : configmap "kube-rbac-proxy" not found
Nov 04 05:49:09.447424 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:09.447334    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:09.447424 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:09.447393    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:10.447375588 +0000 UTC m=+39.497055350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:09.479141 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.479030    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"]
Nov 04 05:49:09.484744 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:49:09.484716    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dbb3142_eef1_4900_a295_d72dfb57eb90.slice/crio-2305e912ad9d99590a0e57550bb651ac2ad97468790065ca34551ef434811073 WatchSource:0}: Error finding container 2305e912ad9d99590a0e57550bb651ac2ad97468790065ca34551ef434811073: Status 404 returned error can't find the container with id 2305e912ad9d99590a0e57550bb651ac2ad97468790065ca34551ef434811073
Nov 04 05:49:09.648584 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.648539    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx" event={"ID":"4dbb3142-eef1-4900-a295-d72dfb57eb90","Type":"ContainerStarted","Data":"2305e912ad9d99590a0e57550bb651ac2ad97468790065ca34551ef434811073"}
Nov 04 05:49:09.661144 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.661107    2568 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-cmx55"]
Nov 04 05:49:09.674117 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.674098    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.693335 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.693314    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-smqxt-th6hc"]
Nov 04 05:49:09.725977 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.725951    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-cmx55"]
Nov 04 05:49:09.732485 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.732393    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6xqtp\""
Nov 04 05:49:09.732485 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.732395    2568 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 04 05:49:09.732726 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.732708    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 04 05:49:09.732726 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.732717    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 04 05:49:09.732869 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.732740    2568 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 04 05:49:09.748820 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.748791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-key\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.748923 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.748835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-cabundle\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.748988 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.748940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjx7k\" (UniqueName: \"kubernetes.io/projected/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-kube-api-access-rjx7k\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.819506 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:49:09.819467    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee2686a_510f_46c5_a192_f39508e25e48.slice/crio-7bef305f8ea3701368bd54f5407ddf1ca08d21c94c37338ab4067dfc80841698 WatchSource:0}: Error finding container 7bef305f8ea3701368bd54f5407ddf1ca08d21c94c37338ab4067dfc80841698: Status 404 returned error can't find the container with id 7bef305f8ea3701368bd54f5407ddf1ca08d21c94c37338ab4067dfc80841698
Nov 04 05:49:09.849304 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.849271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-key\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.849405 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.849317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-cabundle\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.849405 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.849358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7k\" (UniqueName: \"kubernetes.io/projected/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-kube-api-access-rjx7k\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.850116 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.850092    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-cabundle\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.852118 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.852100    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-key\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:09.899097 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.899072    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:09.915782 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:09.915756    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjx7k\" (UniqueName: \"kubernetes.io/projected/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-kube-api-access-rjx7k\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:10.009355 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.009298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:10.044090 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.044061    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:10.152568 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.152534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:10.153027 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:10.152717    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:10.153027 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:10.152803    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:18.152781232 +0000 UTC m=+47.202461007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:10.403946 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.403920    2568 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-cmx55"]
Nov 04 05:49:10.409473 ip-10-0-143-195 kubenswrapper[2568]: W1104 05:49:10.405969    2568 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ec8d3c_f043_4a15_9ea9_f0614f652d2c.slice/crio-fa886a5bc33e09c45121e8ba257d5863dd83ffc5088d880d636050451c2613f5 WatchSource:0}: Error finding container fa886a5bc33e09c45121e8ba257d5863dd83ffc5088d880d636050451c2613f5: Status 404 returned error can't find the container with id fa886a5bc33e09c45121e8ba257d5863dd83ffc5088d880d636050451c2613f5
Nov 04 05:49:10.455779 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.455752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:10.455904 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.455823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:10.455970 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:10.455903    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:49:10.455970 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:10.455938    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:10.456080 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:10.455971    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:12.455951152 +0000 UTC m=+41.505630932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : configmap "kube-rbac-proxy" not found
Nov 04 05:49:10.456080 ip-10-0-143-195 kubenswrapper[2568]: E1104 05:49:10.455992    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:12.45598033 +0000 UTC m=+41.505660098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:10.483721 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.483692    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:10.653218 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.653131    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x4mpr" event={"ID":"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef","Type":"ContainerStarted","Data":"c13129ed6356f4e4c69abeb096218b0afd6230f864efbd31a165c0612a4ce2ab"}
Nov 04 05:49:10.653368 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.653232    2568 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:10.654828 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.654798    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-smqxt-th6hc" event={"ID":"6ee2686a-510f-46c5-a192-f39508e25e48","Type":"ContainerStarted","Data":"7bef305f8ea3701368bd54f5407ddf1ca08d21c94c37338ab4067dfc80841698"}
Nov 04 05:49:10.656540 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.656511    2568 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55" event={"ID":"49ec8d3c-f043-4a15-9ea9-f0614f652d2c","Type":"ContainerStarted","Data":"fa886a5bc33e09c45121e8ba257d5863dd83ffc5088d880d636050451c2613f5"}
Nov 04 05:49:10.780587 ip-10-0-143-195 kubenswrapper[2568]: I1104 05:49:10.780527    2568 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x4mpr" podStartSLOduration=34.816225131 podStartE2EDuration="38.780513006s" totalImagesPullingTime="3.964287875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:10.779956046 +0000 UTC m=+39.829635849" watchObservedRunningTime="2026-11-04 05:49:10.780513006 +0000 UTC m=+39.830192790"
Nov 04 05:49:12.005318 ip-10-0-143-195 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 05:49:12.018310 ip-10-0-143-195 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 05:49:12.018503 ip-10-0-143-195 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 05:49:12.018560 ip-10-0-143-195 systemd[1]: kubelet.service: Consumed 2.315s CPU time.
Nov 04 05:49:12.028542 ip-10-0-143-195 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 05:49:12.115313 ip-10-0-143-195 kubenswrapper[4497]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:49:12.115313 ip-10-0-143-195 kubenswrapper[4497]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 05:49:12.115313 ip-10-0-143-195 kubenswrapper[4497]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:49:12.115313 ip-10-0-143-195 kubenswrapper[4497]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:49:12.117815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117725    4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:49:12.117815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117815    4497 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:49:12.117815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117820    4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117825    4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117830    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117835    4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117840    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117845    4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117850    4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117856    4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117860    4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117868    4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117877    4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117898    4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117903    4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117909    4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117914    4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117919    4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117924    4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117929    4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117934    4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:49:12.118026 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117939    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117944    4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117949    4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117954    4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117971    4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117976    4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117981    4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117985    4497 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117990    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117994    4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.117998    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118001    4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118004    4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118007    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118009    4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118012    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118015    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118017    4497 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118020    4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118022    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:49:12.118608 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118025    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118028    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118031    4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118034    4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118036    4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118039    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118042    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118046    4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118050    4497 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118053    4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118055    4497 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118058    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118061    4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118063    4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118066    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118069    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118074    4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118078    4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118083    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:49:12.119290 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118088    4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118094    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118100    4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118105    4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118110    4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118116    4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118121    4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118124    4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118126    4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118129    4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118131    4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118134    4497 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118136    4497 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118139    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118142    4497 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118145    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118148    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118150    4497 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118153    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118156    4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:49:12.119880 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118158    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118168    4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118172    4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118175    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118177    4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118180    4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118183    4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118185    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118188    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118190    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118193    4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118195    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118198    4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118201    4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118203    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118206    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118209    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118211    4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118214    4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:49:12.120519 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118217    4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118221    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118226    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118230    4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118235    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118240    4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.118243    4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119055    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119066    4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119072    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119078    4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119081    4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119084    4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119087    4497 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119089    4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119093    4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119098    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119103    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119107    4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119112    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:49:12.121106 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119115    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119118    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119120    4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119123    4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119126    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119129    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119132    4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119134    4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119137    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119139    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119147    4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119149    4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119153    4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119156    4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119159    4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119161    4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119164    4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119168    4497 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119176    4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:49:12.121694 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119182    4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119186    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119189    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119192    4497 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119196    4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119199    4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119202    4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119205    4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119208    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119211    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119213    4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119217    4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119220    4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119222    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119225    4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119228    4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119231    4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119233    4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119236    4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119238    4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:49:12.122337 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119241    4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119246    4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119251    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119258    4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119262    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119264    4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119267    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119270    4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119273    4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119276    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119278    4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119281    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119283    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119286    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119288    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119291    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119293    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119296    4497 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119298    4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119301    4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:49:12.122903 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119304    4497 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119306    4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119309    4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119314    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119316    4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119319    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119323    4497 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119327    4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119332    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119337    4497 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119341    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119344    4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119346    4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119349    4497 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119351    4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119355    4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119358    4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119360    4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119363    4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119367    4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:49:12.123555 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119369    4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119372    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119374    4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119377    4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119380    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119382    4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119385    4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119387    4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119390    4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119392    4497 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119395    4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119398    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119402    4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.119407    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120015    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120028    4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120031    4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120034    4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120037    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:49:12.124263 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120040    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120042    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120045    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120048    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120051    4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120054    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120056    4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120059    4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120063    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120067    4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120072    4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120078    4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120087    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120090    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120093    4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120098    4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120103    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120108    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120112    4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:49:12.124849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120116    4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120121    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120127    4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120132    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120137    4497 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120142    4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120147    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120152    4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120157    4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120163    4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120166    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120169    4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120172    4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120174    4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120177    4497 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120179    4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120182    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120184    4497 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120187    4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120190    4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:49:12.125524 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120192    4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120196    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120199    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120201    4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120204    4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120208    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120221    4497 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120227    4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120230    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120233    4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120236    4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120238    4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120241    4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120245    4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120251    4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120257    4497 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120261    4497 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120263    4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120266    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120268    4497 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:49:12.126193 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120272    4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120276    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120278    4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120281    4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120284    4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120289    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120294    4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120299    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120304    4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120307    4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120309    4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120312    4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120314    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120318    4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120321    4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120323    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120326    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120328    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120331    4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:49:12.126849 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120339    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120342    4497 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120345    4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120347    4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120351    4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120354    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120358    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120363    4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120368    4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120371    4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120373    4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120377    4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120382    4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120387    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120391    4497 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120394    4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120396    4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120399    4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120401    4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120404    4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:49:12.127583 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120406    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120409    4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.120411    4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120527    4497 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120539    4497 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120551    4497 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120560    4497 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120566    4497 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120572    4497 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120580    4497 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120587    4497 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120593    4497 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120598    4497 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120604    4497 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120607    4497 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120610    4497 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120614    4497 flags.go:64] FLAG: --cgroup-root=""
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120616    4497 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120619    4497 flags.go:64] FLAG: --client-ca-file=""
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120622    4497 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120625    4497 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120629    4497 flags.go:64] FLAG: --cluster-domain=""
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120631    4497 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 05:49:12.128183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120634    4497 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120637    4497 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120640    4497 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120647    4497 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120653    4497 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120658    4497 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120664    4497 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120669    4497 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120674    4497 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120678    4497 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120683    4497 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120688    4497 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120695    4497 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120701    4497 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120704    4497 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120708    4497 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120711    4497 flags.go:64] FLAG: --enable-server="true"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120714    4497 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120719    4497 flags.go:64] FLAG: --event-burst="100"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120722    4497 flags.go:64] FLAG: --event-qps="50"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120725    4497 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120728    4497 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120730    4497 flags.go:64] FLAG: --eviction-hard=""
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120735    4497 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 05:49:12.128817 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120738    4497 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120741    4497 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120744    4497 flags.go:64] FLAG: --eviction-soft=""
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120747    4497 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120751    4497 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120754    4497 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120757    4497 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120759    4497 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120762    4497 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120765    4497 flags.go:64] FLAG: --feature-gates=""
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120769    4497 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120773    4497 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120777    4497 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120780    4497 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120783    4497 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120786    4497 flags.go:64] FLAG: --help="false"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120792    4497 flags.go:64] FLAG: --hostname-override="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120797    4497 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120803    4497 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120807    4497 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120813    4497 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120817    4497 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120826    4497 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 05:49:12.129524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120831    4497 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120834    4497 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120837    4497 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120840    4497 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120843    4497 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120846    4497 flags.go:64] FLAG: --kube-reserved=""
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120849    4497 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120852    4497 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120855    4497 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120863    4497 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120866    4497 flags.go:64] FLAG: --lock-file=""
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120869    4497 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120872    4497 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120875    4497 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120880    4497 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120899    4497 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120902    4497 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120905    4497 flags.go:64] FLAG: --logging-format="text"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120908    4497 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120911    4497 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120915    4497 flags.go:64] FLAG: --manifest-url=""
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120918    4497 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120923    4497 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120926    4497 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120931    4497 flags.go:64] FLAG: --max-pods="110"
Nov 04 05:49:12.130507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120936    4497 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120941    4497 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120947    4497 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120953    4497 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120958    4497 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120963    4497 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120968    4497 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120982    4497 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120987    4497 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120993    4497 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.120998    4497 flags.go:64] FLAG: --pod-cidr=""
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121003    4497 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121007    4497 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121013    4497 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121018    4497 flags.go:64] FLAG: --port="10250"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121022    4497 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121025    4497 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0b0044cefcbaf8d4f"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121036    4497 flags.go:64] FLAG: --qos-reserved=""
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121042    4497 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121048    4497 flags.go:64] FLAG: --register-node="true"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121052    4497 flags.go:64] FLAG: --register-with-taints=""
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121057    4497 flags.go:64] FLAG: --registry-burst="10"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121059    4497 flags.go:64] FLAG: --registry-qps="5"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121062    4497 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121065    4497 flags.go:64] FLAG: --reserved-memory=""
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121069    4497 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 05:49:12.131429 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121074    4497 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121082    4497 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121088    4497 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121093    4497 flags.go:64] FLAG: --runonce="false"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121098    4497 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121103    4497 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121109    4497 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121114    4497 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121119    4497 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121125    4497 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121130    4497 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121135    4497 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121139    4497 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121145    4497 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121150    4497 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121153    4497 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121156    4497 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121159    4497 flags.go:64] FLAG: --system-cgroups=""
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121162    4497 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121168    4497 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121171    4497 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121173    4497 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121177    4497 flags.go:64] FLAG: --tls-min-version=""
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121180    4497 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121189    4497 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 05:49:12.132263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121192    4497 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121195    4497 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121198    4497 flags.go:64] FLAG: --v="2"
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121202    4497 flags.go:64] FLAG: --version="false"
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121206    4497 flags.go:64] FLAG: --vmodule=""
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121210    4497 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121213    4497 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121433    4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121442    4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121448    4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121453    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121456    4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121459    4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121461    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121464    4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121466    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121469    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121471    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121474    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121477    4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:49:12.133001 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121479    4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121481    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121485    4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121490    4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121494    4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121497    4497 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121500    4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121503    4497 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121505    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121508    4497 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121510    4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121513    4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121523    4497 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121526    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121528    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121531    4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121533    4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121535    4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121538    4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:49:12.133592 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121541    4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121545    4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121548    4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121552    4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121557    4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121562    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121566    4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121571    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121576    4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121579    4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121588    4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121591    4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121596    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121600    4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121605    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121610    4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121616    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121621    4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121626    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:49:12.134277 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121630    4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121634    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121636    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121638    4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121641    4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121643    4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121646    4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121654    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121657    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121660    4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121662    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121665    4497 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121667    4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121670    4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121674    4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121678    4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121683    4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121688    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121693    4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121698    4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:49:12.134961 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121702    4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121708    4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121712    4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121718    4497 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121722    4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121728    4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121732    4497 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121737    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121741    4497 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121746    4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121752    4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121757    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121762    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121765    4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121768    4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121770    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121773    4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121778    4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121783    4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121788    4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:49:12.135562 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121799    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121803    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121805    4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121808    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121810    4497 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121813    4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121816    4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121819    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121821    4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121825    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121829    4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121834    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121839    4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121844    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121849    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.121905    4497 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:49:12.136181 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121958    4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121963    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121966    4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121969    4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121972    4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121974    4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121977    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121984    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121988    4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121993    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.121998    4497 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122003    4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122007    4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122010    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122012    4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122015    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122017    4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122027    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122032    4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122036    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:49:12.136663 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122041    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122046    4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122050    4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122055    4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122060    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122063    4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122066    4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122070    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122074    4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122080    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122085    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122088    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122091    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122093    4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122096    4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122098    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122102    4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122107    4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:49:12.137316 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122110    4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122115    4497 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122118    4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122121    4497 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122123    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122126    4497 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122128    4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122131    4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122133    4497 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122136    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122139    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122141    4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122157    4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122169    4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122172    4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122175    4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122177    4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122187    4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122190    4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122193    4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:49:12.137833 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122196    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122198    4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122201    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122204    4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122206    4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122211    4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122215    4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122220    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122225    4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122229    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122234    4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122239    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122243    4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122249    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122251    4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122254    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122256    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122259    4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122261    4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:49:12.138567 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122264    4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122267    4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122270    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122272    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122274    4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122277    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122286    4497 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122289    4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122291    4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122294    4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122296    4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122299    4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122301    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122303    4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122306    4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122308    4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122311    4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122313    4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122318    4497 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122322    4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:49:12.139373 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122329    4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122333    4497 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122336    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122338    4497 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122342    4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122348    4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122354    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122357    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.122360    4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.127203    4497 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.127218    4497 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.127237    4497 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.127244    4497 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127323    4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127328    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127331    4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127334    4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127337    4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127349    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:49:12.139934 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127354    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127358    4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127370    4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127375    4497 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127379    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127384    4497 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127391    4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127398    4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127405    4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127410    4497 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127417    4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127422    4497 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127426    4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127429    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127432    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127435    4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127438    4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127440    4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127443    4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:49:12.140500 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127445    4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127448    4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127450    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127453    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127456    4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127458    4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127461    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127463    4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127466    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127469    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127471    4497 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127473    4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127476    4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127484    4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127487    4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127490    4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127492    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127495    4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127497    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:49:12.141243 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127499    4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127502    4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127504    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127507    4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127510    4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127513    4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127515    4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127517    4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127520    4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127523    4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127525    4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127528    4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127530    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127533    4497 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127535    4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127539    4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127543    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127547    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127550    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127554    4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:49:12.141823 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127559    4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127562    4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127566    4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127570    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127574    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127578    4497 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127582    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127593    4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127597    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127601    4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127605    4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127609    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127612    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127614    4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127616    4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127619    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127621    4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127624    4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127627    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127629    4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:49:12.142496 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127631    4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127634    4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127636    4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127638    4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127641    4497 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127643    4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127646    4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127649    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127651    4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127654    4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127656    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127658    4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127661    4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127663    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127666    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127668    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127670    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127673    4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127675    4497 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127677    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:49:12.143118 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127685    4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127688    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.127734    4497 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127947    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127952    4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127955    4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127957    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127960    4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127963    4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127965    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127968    4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127971    4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127976    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127980    4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127985    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127988    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:49:12.143672 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127990    4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127993    4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127996    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.127998    4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128003    4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128006    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128008    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128011    4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128013    4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128016    4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128018    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128021    4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128023    4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128026    4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128028    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128031    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128033    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128042    4497 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128046    4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128052    4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:49:12.144174 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128056    4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128060    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128065    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128069    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128073    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128078    4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128082    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128086    4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128091    4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128095    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128099    4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128102    4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128106    4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128110    4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128114    4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128118    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128122    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128126    4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128130    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128134    4497 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:49:12.144741 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128138    4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128140    4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128142    4497 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128145    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128149    4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128153    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128156    4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128159    4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128162    4497 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128164    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128173    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128176    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128178    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128181    4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128184    4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128189    4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128195    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128200    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128205    4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:49:12.145346 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128209    4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128214    4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128218    4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128226    4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128230    4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128234    4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128239    4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128243    4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128246    4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128249    4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128251    4497 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128254    4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128256    4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128259    4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128261    4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128264    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128266    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128269    4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128272    4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:49:12.145815 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128274    4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128277    4497 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128279    4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128281    4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128284    4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128294    4497 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128297    4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128299    4497 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128302    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128304    4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128307    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128309    4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128312    4497 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128315    4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128317    4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.128348    4497 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:49:12.146444 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128410    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128418    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128421    4497 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128424    4497 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128427    4497 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128429    4497 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128432    4497 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128435    4497 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128437    4497 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128440    4497 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128442    4497 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128445    4497 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128448    4497 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128450    4497 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128452    4497 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128454    4497 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128457    4497 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128460    4497 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128470    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:49:12.146858 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128475    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128480    4497 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128484    4497 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128495    4497 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128500    4497 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128504    4497 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128508    4497 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128513    4497 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128517    4497 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128521    4497 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128524    4497 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128526    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128529    4497 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128531    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128535    4497 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128538    4497 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128540    4497 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128543    4497 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128545    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128548    4497 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:49:12.147391 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128550    4497 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128553    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128555    4497 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128558    4497 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128560    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128562    4497 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128565    4497 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128568    4497 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128570    4497 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128573    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128575    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128578    4497 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128580    4497 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128585    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128587    4497 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128590    4497 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128598    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128600    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128603    4497 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:49:12.147967 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128605    4497 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128608    4497 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128612    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128616    4497 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128620    4497 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128624    4497 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128628    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128633    4497 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128637    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128642    4497 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128646    4497 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128649    4497 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128651    4497 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128654    4497 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128656    4497 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128659    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128661    4497 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128664    4497 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128666    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128668    4497 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:49:12.148507 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128671    4497 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128674    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128676    4497 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128680    4497 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128684    4497 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128688    4497 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128694    4497 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128699    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128702    4497 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128705    4497 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128714    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128717    4497 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128719    4497 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128723    4497 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128727    4497 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128731    4497 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128737    4497 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128741    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128744    4497 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128749    4497 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:49:12.149107 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128751    4497 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128753    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128756    4497 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128759    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128761    4497 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128764    4497 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128766    4497 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:12.128770    4497 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.128834    4497 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.130766    4497 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.130835    4497 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.131559    4497 server.go:1014] "Starting client certificate rotation"
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.131688    4497 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.131762    4497 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:43:32 +0000 UTC" deadline="2028-04-06 05:40:35.884636078 +0000 UTC"
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.131815    4497 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12455h51m23.752824655s"
Nov 04 05:49:12.149746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.132123    4497 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:49:12.150314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.133520    4497 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:49:12.150314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.135749    4497 log.go:25] "Validated CRI v1 runtime API"
Nov 04 05:49:12.150314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.137697    4497 log.go:25] "Validated CRI v1 image API"
Nov 04 05:49:12.150314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.138595    4497 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 05:49:12.150314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.140658    4497 fs.go:135] Filesystem UUIDs: map[13806b24-130a-4854-8105-8d5af4a634c6:/dev/nvme0n1p4 322e2992-a8ad-40c9-bf14-b7a256d898b7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Nov 04 05:49:12.150488 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.140677    4497 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/037598b14878d232c87a82d475474a0024c1503a7c9b21d4377684721c914bec/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/037598b14878d232c87a82d475474a0024c1503a7c9b21d4377684721c914bec/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0c384b6b359fe7dc73522b68fb47150bc99f60d8c46ea9fa750799c315526568/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0c384b6b359fe7dc73522b68fb47150bc99f60d8c46ea9fa750799c315526568/userdata/shm major:0 minor:208 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1829d5c80bc965c146fe05760658b02f0943cf6056767784d8b115eadd0b7779/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1829d5c80bc965c146fe05760658b02f0943cf6056767784d8b115eadd0b7779/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2305e912ad9d99590a0e57550bb651ac2ad97468790065ca34551ef434811073/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2305e912ad9d99590a0e57550bb651ac2ad97468790065ca34551ef434811073/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3f0655dad32a25b03be2f07d3d67e1a599261553d9175b3432d5586ba011a3b1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3f0655dad32a25b03be2f07d3d67e1a599261553d9175b3432d5586ba011a3b1/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/57e6a5652d09c184236c2f1d08a35acb7b0f6a08ff4a5807e9e4c7302fd1f23f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/57e6a5652d09c184236c2f1d08a35acb7b0f6a08ff4a5807e9e4c7302fd1f23f/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5bcbb5877bf8814c731412d596b75feee7ab8df7a4c6b8f0ec27a7ebc4c3155c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5bcbb5877bf8814c731412d596b75feee7ab8df7a4c6b8f0ec27a7ebc4c3155c/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/62da034aef86751f5bbff871dbd53556b1b56510df2ad20aad674145c9fcad9b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/62da034aef86751f5bbff871dbd53556b1b56510df2ad20aad674145c9fcad9b/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7bef305f8ea3701368bd54f5407ddf1ca08d21c94c37338ab4067dfc80841698/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7bef305f8ea3701368bd54f5407ddf1ca08d21c94c37338ab4067dfc80841698/userdata/shm major:0 minor:227 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7e969e5805dd9141ab043a7710e01fe69474a7dcdf41d34b154460180776be81/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7e969e5805dd9141ab043a7710e01fe69474a7dcdf41d34b154460180776be81/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/888b7cefe688285471279c5c7557408a200fa06783e3eeaf74d898d3069a4727/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/888b7cefe688285471279c5c7557408a200fa06783e3eeaf74d898d3069a4727/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/afd00ea868af33eccfacc78bb6e1de5f93305ba6960d464ad23d775633953d4e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/afd00ea868af33eccfacc78bb6e1de5f93305ba6960d464ad23d775633953d4e/userdata/shm major:0 minor:83 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b02f32240459905faa07ecd15f0d385ef84f23f848da3f0fd7b2c70f9462f38f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b02f32240459905faa07ecd15f0d385ef84f23f848da3f0fd7b2c70f9462f38f/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/df747e1eee46b064ca13ffd6348ddbe96fd4016538a9da89dead656429ddf262/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/df747e1eee46b064ca13ffd6348ddbe96fd4016538a9da89dead656429ddf262/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e9194a1abff28c086f0aaab6b8d5ff64b8a8767126bb3e22bdfd5e9a2a9e4d32/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e9194a1abff28c086f0aaab6b8d5ff64b8a8767126bb3e22bdfd5e9a2a9e4d32/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fa886a5bc33e09c45121e8ba257d5863dd83ffc5088d880d636050451c2613f5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fa886a5bc33e09c45121e8ba257d5863dd83ffc5088d880d636050451c2613f5/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1365fa77-d96f-45c6-be2e-fa85586ee67a/volumes/kubernetes.io~projected/kube-api-access-swzq4:{mountpoint:/var/lib/kubelet/pods/1365fa77-d96f-45c6-be2e-fa85586ee67a/volumes/kubernetes.io~projected/kube-api-access-swzq4 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2b0ce883-a723-48cc-a887-9c9db6942a43/volumes/kubernetes.io~projected/kube-api-access-zrg97:{mountpoint:/var/lib/kubelet/pods/2b0ce883-a723-48cc-a887-9c9db6942a43/volumes/kubernetes.io~projected/kube-api-access-zrg97 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49ec8d3c-f043-4a15-9ea9-f0614f652d2c/volumes/kubernetes.io~projected/kube-api-access-rjx7k:{mountpoint:/var/lib/kubelet/pods/49ec8d3c-f043-4a15-9ea9-f0614f652d2c/volumes/kubernetes.io~projected/kube-api-access-rjx7k major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49ec8d3c-f043-4a15-9ea9-f0614f652d2c/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/49ec8d3c-f043-4a15-9ea9-f0614f652d2c/volumes/kubernetes.io~secret/signing-key major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4d26948e-8d34-4cd2-bfe6-0702f4965c1b/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/4d26948e-8d34-4cd2-bfe6-0702f4965c1b/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4dbb3142-eef1-4900-a295-d72dfb57eb90/volumes/kubernetes.io~projected/kube-api-access-zt26d:{mountpoint:/var/lib/kubelet/pods/4dbb3142-eef1-4900-a295-d72dfb57eb90/volumes/kubernetes.io~projected/kube-api-access-zt26d major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~projected/kube-api-access-jxtcr:{mountpoint:/var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~projected/kube-api-access-jxtcr major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6ee2686a-510f-46c5-a192-f39508e25e48/volumes/kubernetes.io~projected/kube-api-access-jngrq:{mountpoint:/var/lib/kubelet/pods/6ee2686a-510f-46c5-a192-f39508e25e48/volumes/kubernetes.io~projected/kube-api-access-jngrq major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8138b678-e6cc-4bb6-9ab6-5b26e8963b25/volumes/kubernetes.io~projected/kube-api-access-fr7pd:{mountpoint:/var/lib/kubelet/pods/8138b678-e6cc-4bb6-9ab6-5b26e8963b25/volumes/kubernetes.io~projected/kube-api-access-fr7pd major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/84b61b57-97fa-42cd-a376-cd9d9d78eeaa/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/84b61b57-97fa-42cd-a376-cd9d9d78eeaa/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0/volumes/kubernetes.io~projected/kube-api-access-b6v4r:{mountpoint:/var/lib/kubelet/pods/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0/volumes/kubernetes.io~projected/kube-api-access-b6v4r major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef/volumes/kubernetes.io~projected/kube-api-access-d5wfm:{mountpoint:/var/lib/kubelet/pods/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef/volumes/kubernetes.io~projected/kube-api-access-d5wfm major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/960698a0-8d7a-4451-bb9a-3da528e49130/volumes/kubernetes.io~projected/kube-api-access-wkbmm:{mountpoint:/var/lib/kubelet/pods/960698a0-8d7a-4451-bb9a-3da528e49130/volumes/kubernetes.io~projected/kube-api-access-wkbmm major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc242644-0d8b-4303-ab8f-a495cd324938/volumes/kubernetes.io~projected/kube-api-access-tcqsh:{mountpoint:/var/lib/kubelet/pods/cc242644-0d8b-4303-ab8f-a495cd324938/volumes/kubernetes.io~projected/kube-api-access-tcqsh major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc242644-0d8b-4303-ab8f-a495cd324938/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/cc242644-0d8b-4303-ab8f-a495cd324938/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd63c0ac-166d-4805-9cce-2759db31106d/volumes/kubernetes.io~projected/kube-api-access-qzkjh:{mountpoint:/var/lib/kubelet/pods/cd63c0ac-166d-4805-9cce-2759db31106d/volumes/kubernetes.io~projected/kube-api-access-qzkjh major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf1a9959-1d76-4da9-b119-9fe97b9499d5/volumes/kubernetes.io~projected/kube-api-access-gd2b2:{mountpoint:/var/lib/kubelet/pods/cf1a9959-1d76-4da9-b119-9fe97b9499d5/volumes/kubernetes.io~projected/kube-api-access-gd2b2 major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volumes/kubernetes.io~projected/kube-api-access-rk9lz:{mountpoint:/var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volumes/kubernetes.io~projected/kube-api-access-rk9lz major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7816f19-a486-4310-810e-3c8fdaf82f81/volumes/kubernetes.io~projected/kube-api-access-7p2nb:{mountpoint:/var/lib/kubelet/pods/e7816f19-a486-4310-810e-3c8fdaf82f81/volumes/kubernetes.io~projected/kube-api-access-7p2nb major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0d57b8d-62e0-4e04-af9f-4006db8324f7/volumes/kubernetes.io~projected/kube-api-access-s4wpn:{mountpoint:/var/lib/kubelet/pods/f0d57b8d-62e0-4e04-af9f-4006db8324f7/volumes/kubernetes.io~projected/kube-api-access-s4wpn major:0 minor:63 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/e5dcb4b83a5959537492fb9d98894d873a563e6253ba849e98480e54fe815094/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/6251b4e21d5025284db043c0672074c6f0352f102520c32cbd8ecb9cd5d412bf/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/b937889ca890914e6b0e44085dcbf1c82695ec677f8e369cdfc0fa6e45f983b7/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/938c359b9f93208cc9b2f09182c2fcb4580f39241f5baaaab654cc3333baaac7/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/ccdf1cb4d4d7b2a1d53e4b34d988ef988d6e7bde2f22b7f8b6033101cd569b7a/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/18dea6b1d7733de3228d14b7c7e1c2d7e7c4752a11ffdb94ad6288be71ea4854/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/e7ff32fe17d2b3d66aa4e9a21f38a48f6e77e3131e430d8f398d1c0a4132c215/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/196400eb9cb00bb80019a1460f3ef6cc1f4343999551c91f0d87b4e75f5ecf24/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/f7350efcd46b8ce6f27b97247b3166aa7db47ae6354b8cb86969aefb2ade36df/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-131:{mountpoint:/var/lib/containers/storage/overlay/6d9c8d52d4ad1401333711d5d8facd29b8be5c7dc20fbfe5bbe85f91cabfa8e4/merged major:0 minor:131 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/ff83656f05ff0f005e2342a71b11340e0188ddfe6b82c48e1817ebe030fbb47e/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/9cb63baa8c3b851cf96da797ddb098962c8031f532aafe841ec4ee8ccd6e6861/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/40833e458a18fc940077620378d818bc9e0449d50c81cccab2a9017c5ac87674/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/cd6a04f52c868ba8a6caee2da5cd468e305dd9d7d87b57632228520af8ec6a52/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/a7ba8c982310860e09e160db23ae1c2b604bbd3e17d6b3f40f2c894682619ac6/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/191880b18d7905b716579a5f1a0f5518a5b08de0f3d8fdb2c7962d3ed1dd7ca3/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/71bde292ef8a2eaa9093a165ff914bd55fcf364c4cc2ce798b029050aee76dc1/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/96ce4e162b2327f2df7a4549e891077e43bf2420d41620393f94d71c67fbc166/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/142c301ee392e3ebeb92fed239b5028464766a9a20c1ab9a21c3e697ae114a04/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/6cdbea859fe2cfbb7563867243a2bcf6bf03fafec053a7276176b9c19fec597f/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/705618847a951776156be2f77563f8709d380e1668deebe56bec7149fa27ecbd/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/a0126986cb82d56eea025dd1a6d5afe228dc820868648b25b7b3473ee096b539/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-212:{mountpoint:/var/lib/containers/storage/overlay/7809a466cf996ace4f103d2580eca5869a451db88cd57f073e37eaf72420eea9/merged major:0 minor:212 fsType:overlay blockSize:0} overlay_0-214:{mountpoint:/var/lib/containers/storage/overlay/5a7fc42aeb73652624967278613655d74d50dc881cca58c3d0ebea649c7f36a7/merged major:0 minor:214 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/be4e5da0957d369fbf40176692a63995e04f7e0ef97edfed414916ed6395d484/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-229:{mountpoint:/var/lib/containers/storage/overlay/a8aff073365f2183c8effab897cb7d42927b7c38927e36126167786469a9483d/merged major:0 minor:229 fsType:overlay blockSize:0} overlay_0-231:{mountpoint:/var/lib/containers/storage/overlay/a7fd0dbab9f771a9821bbc7667b51e362f8b4028e6cfaeb4e9a7dd3b0ddd9bb8/merged major:0 minor:231 fsType:overlay blockSize:0} overlay_0-234:{mountpoint:/var/lib/containers/storage/overlay/4689edf06bd7325671dcf2395a2858dd815c3d4dbf23913165b4736b6a69f40f/merged major:0 minor:234 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/8c6bb7543089ef6ca1a48617f855e5e9386af718860c8823d8d5676b5cedd81e/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-245:{mountpoint:/var/lib/containers/storage/overlay/c914925950afe694473f4a350842be4596a7c5d3ce1ff8ec179b9cd170eb42cc/merged major:0 minor:245 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/66a8a498bb4164b5e61a2134a68953ce0806962aecd4d96713aa56f5d81e5647/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/a48b938d384bc969d743479307c6713d35905abe7578036edb084bcdc5e3f946/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/12ecd85a16109de1e887eb8a1027dc5c65490e5808a52085f3700ef07fd3264e/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/d2b1356dbddf9ff3fdd328438c326b7e13b84d9ed13b9aadb527a39b562401b1/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/1880adc6c21f856de283560cb4d2c74c3fd3aca018df25a5097a1821e3df3729/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/5d4b234bbae53b7cca9903b3616394da18614e2947cdf853e44ffa85c85b3737/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/e63a6d94c499fbcae17e15464754196fd0a65354b380856c4900a4a1ae911de9/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/8417f25329234ac65479839c75fe561cc3bd7327db7ed73935dba4110efdf408/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/60df3214a1e7b3cec97568155e5bfc7952f2a5daaab8057549c704dc79b87e70/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/329ec2c1a541d8f8220bb73e41074b22f24aa0cf9b781c2be2e6c05492a882c9/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/5822d0a717ee762400d660e71e773d8f65a760ec0dad2de5bae657ff5ad0353b/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.149253    4497 manager.go:217] Machine: {Timestamp:2026-11-04 05:49:12.148425652 +0000 UTC m=+0.079623059 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200029 MemoryCapacity:32812023808 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec213e62afd56d7a470839f13e865acb SystemUUID:ec213e62-afd5-6d7a-4708-39f13e865acb BootID:3feef2a6-ad32-4899-90a6-b38b5b2dc05b Filesystems:[{Device:/var/lib/kubelet/pods/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0/volumes/kubernetes.io~projected/kube-api-access-b6v4r DeviceMajor:0 DeviceMinor:62 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/1365fa77-d96f-45c6-be2e-fa85586ee67a/volumes/kubernetes.io~projected/kube-api-access-swzq4 DeviceMajor:0 DeviceMinor:65 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e9194a1abff28c086f0aaab6b8d5ff64b8a8767126bb3e22bdfd5e9a2a9e4d32/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/df747e1eee46b064ca13ffd6348ddbe96fd4016538a9da89dead656429ddf262/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/57e6a5652d09c184236c2f1d08a35acb7b0f6a08ff4a5807e9e4c7302fd1f23f/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-214 DeviceMajor:0 DeviceMinor:214 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5bcbb5877bf8814c731412d596b75feee7ab8df7a4c6b8f0ec27a7ebc4c3155c/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/84b61b57-97fa-42cd-a376-cd9d9d78eeaa/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~projected/kube-api-access-jxtcr DeviceMajor:0 DeviceMinor:61 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/888b7cefe688285471279c5c7557408a200fa06783e3eeaf74d898d3069a4727/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406011904 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-234 DeviceMajor:0 DeviceMinor:234 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3f0655dad32a25b03be2f07d3d67e1a599261553d9175b3432d5586ba011a3b1/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/62da034aef86751f5bbff871dbd53556b1b56510df2ad20aad674145c9fcad9b/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/e7816f19-a486-4310-810e-3c8fdaf82f81/volumes/kubernetes.io~projected/kube-api-access-7p2nb DeviceMajor:0 DeviceMinor:67 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b02f32240459905faa07ecd15f0d385ef84f23f848da3f0fd7b2c70f9462f38f/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/cd63c0ac-166d-4805-9cce-2759db31106d/volumes/kubernetes.io~projected/kube-api-access-qzkjh DeviceMajor:0 DeviceMinor:64 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2b0ce883-a723-48cc-a887-9c9db6942a43/volumes/kubernetes.io~projected/kube-api-access-zrg97 DeviceMajor:0 DeviceMinor:223 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7bef305f8ea3701368bd54f5407ddf1ca08d21c94c37338ab4067dfc80841698/userdata/shm DeviceMajor:0 DeviceMinor:227 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-231 DeviceMajor:0 DeviceMinor:231 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/037598b14878d232c87a82d475474a0024c1503a7c9b21d4377684721c914bec/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/8138b678-e6cc-4bb6-9ab6-5b26e8963b25/volumes/kubernetes.io~projected/kube-api-access-fr7pd DeviceMajor:0 DeviceMinor:59 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/49ec8d3c-f043-4a15-9ea9-f0614f652d2c/volumes/kubernetes.io~projected/kube-api-access-rjx7k DeviceMajor:0 DeviceMinor:241 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4d26948e-8d34-4cd2-bfe6-0702f4965c1b/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:206 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/afd00ea868af33eccfacc78bb6e1de5f93305ba6960d464ad23d775633953d4e/userdata/shm DeviceMajor:0 DeviceMinor:83 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-131 DeviceMajor:0 DeviceMinor:131 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf1a9959-1d76-4da9-b119-9fe97b9499d5/volumes/kubernetes.io~projected/kube-api-access-gd2b2 DeviceMajor:0 DeviceMinor:197 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/cc242644-0d8b-4303-ab8f-a495cd324938/volumes/kubernetes.io~projected/kube-api-access-tcqsh DeviceMajor:0 DeviceMinor:201 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/4dbb3142-eef1-4900-a295-d72dfb57eb90/volumes/kubernetes.io~projected/kube-api-access-zt26d DeviceMajor:0 DeviceMinor:218 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2305e912ad9d99590a0e57550bb651ac2ad97468790065ca34551ef434811073/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/960698a0-8d7a-4451-bb9a-3da528e49130/volumes/kubernetes.io~projected/kube-api-access-wkbmm DeviceMajor:0 DeviceMinor:60 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1829d5c80bc965c146fe05760658b02f0943cf6056767784d8b115eadd0b7779/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/5e10d4d3-40d6-4020-b19e-a72fecf919bc/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/49ec8d3c-f043-4a15-9ea9-f0614f652d2c/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:233 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cc242644-0d8b-4303-ab8f-a495cd324938/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-212 DeviceMajor:0 DeviceMinor:212 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-245 DeviceMajor:0 DeviceMinor:245 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e49a7b69-154b-44a8-b678-ee31d9bda0de/volumes/kubernetes.io~projected/kube-api-access-rk9lz DeviceMajor:0 DeviceMinor:66 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0c384b6b359fe7dc73522b68fb47150bc99f60d8c46ea9fa750799c315526568/userdata/shm DeviceMajor:0 DeviceMinor:208 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7e969e5805dd9141ab043a7710e01fe69474a7dcdf41d34b154460180776be81/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:/var/lib/kubelet/pods/6ee2686a-510f-46c5-a192-f39508e25e48/volumes/kubernetes.io~projected/kube-api-access-jngrq DeviceMajor:0 DeviceMinor:226 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fa886a5bc33e09c45121e8ba257d5863dd83ffc5088d880d636050451c2613f5/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f0d57b8d-62e0-4e04-af9f-4006db8324f7/volumes/kubernetes.io~projected/kube-api-access-s4wpn DeviceMajor:0 DeviceMinor:63 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef/volumes/kubernetes.io~projected/kube-api-access-d5wfm DeviceMajor:0 DeviceMinor:207 Capacity:31633424384 Type:vfs Inodes:4005374 HasInodes:true} {Device:overlay_0-229 DeviceMajor:0 DeviceMinor:229 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0c384b6b359fe7d MacAddress:32:bd:26:d8:90:69 Speed:10000 Mtu:8901} {Name:2305e912ad9d995 MacAddress:b2:c9:1e:06:0b:5a Speed:10000 Mtu:8901} {Name:57e6a5652d09c18 MacAddress:b6:fc:2e:f2:12:5b Speed:10000 Mtu:8901} {Name:7bef305f8ea3701 MacAddress:12:50:4f:c0:19:6a Speed:10000 Mtu:8901} {Name:7e969e5805dd914 MacAddress:56:53:46:85:9e:81 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:31:8a:df:27:fb Speed:0 Mtu:9001} {Name:br-int MacAddress:0e:1d:ab:b7:6b:56 Speed:0 Mtu:8901} {Name:ens5 MacAddress:02:31:8a:df:27:fb Speed:0 Mtu:9001} {Name:fa886a5bc33e09c MacAddress:5a:4f:6f:d5:fe:39 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:fe:50:69:12:34:8b Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ba:fb:f6:4a:c3:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812023808 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.149661    4497 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.149712    4497 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150058    4497 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150078    4497 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-195.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150233    4497 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150241    4497 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150251    4497 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150268    4497 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150351    4497 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150519    4497 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150659    4497 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 05:49:12.150698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150696    4497 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 05:49:12.151386 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150710    4497 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 05:49:12.151386 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150723    4497 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 05:49:12.151386 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150735    4497 kubelet.go:405] "Adding apiserver pod source"
Nov 04 05:49:12.151386 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.150753    4497 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 05:49:12.151850 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.151832    4497 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 05:49:12.151850 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.151850    4497 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:49:12.153290 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.152933    4497 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 05:49:12.162775 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.162757    4497 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 05:49:12.162775 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.162775    4497 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:49:12.162935 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.162902    4497 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 05:49:12.163180 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163165    4497 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 05:49:12.163264 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163214    4497 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 05:49:12.163352 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163338    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 05:49:12.163399 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163365    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 05:49:12.163399 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163375    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 05:49:12.163399 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163384    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 05:49:12.163399 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163392    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 05:49:12.163399 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163398    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 05:49:12.163594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163404    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 05:49:12.163594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163412    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 05:49:12.163594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163422    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 05:49:12.163594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163432    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 05:49:12.163594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163443    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 05:49:12.163594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163456    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 05:49:12.163594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163490    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 05:49:12.163594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.163498    4497 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 05:49:12.167472 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.167454    4497 server.go:1263] "Started kubelet"
Nov 04 05:49:12.167857 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.167780    4497 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 05:49:12.167968 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.167880    4497 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 05:49:12.167968 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.167871    4497 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 05:49:12.167977 ip-10-0-143-195 systemd[1]: Started Kubernetes Kubelet.
Nov 04 05:49:12.168275 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.168221    4497 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 05:49:12.169168 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.169155    4497 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 05:49:12.169797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.169780    4497 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 05:49:12.170116 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.170099    4497 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 05:49:12.170240 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.170220    4497 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 05:49:12.170240 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.170241    4497 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 05:49:12.170351 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.170318    4497 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 05:49:12.171594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171561    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf1a9959-1d76-4da9-b119-9fe97b9499d5" volumeName="kubernetes.io/configmap/cf1a9959-1d76-4da9-b119-9fe97b9499d5-config-volume" seLinuxMountContext=""
Nov 04 05:49:12.171594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171594    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf1a9959-1d76-4da9-b119-9fe97b9499d5" volumeName="kubernetes.io/empty-dir/cf1a9959-1d76-4da9-b119-9fe97b9499d5-tmp-dir" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171603    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b0ce883-a723-48cc-a887-9c9db6942a43" volumeName="kubernetes.io/empty-dir/2b0ce883-a723-48cc-a887-9c9db6942a43-data-volume" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171616    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5e10d4d3-40d6-4020-b19e-a72fecf919bc" volumeName="kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-tuned" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171627    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e49a7b69-154b-44a8-b678-ee31d9bda0de" volumeName="kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-config" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171637    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0d57b8d-62e0-4e04-af9f-4006db8324f7" volumeName="kubernetes.io/projected/f0d57b8d-62e0-4e04-af9f-4006db8324f7-kube-api-access-s4wpn" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171648    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ee2686a-510f-46c5-a192-f39508e25e48" volumeName="kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171658    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84b61b57-97fa-42cd-a376-cd9d9d78eeaa" volumeName="kubernetes.io/configmap/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-konnectivity-ca" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171670    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="960698a0-8d7a-4451-bb9a-3da528e49130" volumeName="kubernetes.io/projected/960698a0-8d7a-4451-bb9a-3da528e49130-kube-api-access-wkbmm" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171681    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd63c0ac-166d-4805-9cce-2759db31106d" volumeName="kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171691    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8138b678-e6cc-4bb6-9ab6-5b26e8963b25" volumeName="kubernetes.io/empty-dir/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-tmp-dir" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171701    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c2a2e06-d054-47ef-a4c9-d4f7a76009a0" volumeName="kubernetes.io/projected/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-kube-api-access-b6v4r" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171711    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd63c0ac-166d-4805-9cce-2759db31106d" volumeName="kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-binary-copy" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171718    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ca4017d-de12-4d9f-be61-b1a5aeaea9ef" volumeName="kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171727    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1365fa77-d96f-45c6-be2e-fa85586ee67a" volumeName="kubernetes.io/projected/1365fa77-d96f-45c6-be2e-fa85586ee67a-kube-api-access-swzq4" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171734    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49ec8d3c-f043-4a15-9ea9-f0614f652d2c" volumeName="kubernetes.io/configmap/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-cabundle" seLinuxMountContext=""
Nov 04 05:49:12.171731 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171740    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84b61b57-97fa-42cd-a376-cd9d9d78eeaa" volumeName="kubernetes.io/secret/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-agent-certs" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171748    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0d57b8d-62e0-4e04-af9f-4006db8324f7" volumeName="kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-daemon-config" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171755    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ee2686a-510f-46c5-a192-f39508e25e48" volumeName="kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171761    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8138b678-e6cc-4bb6-9ab6-5b26e8963b25" volumeName="kubernetes.io/projected/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-kube-api-access-fr7pd" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171768    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd63c0ac-166d-4805-9cce-2759db31106d" volumeName="kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171775    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd63c0ac-166d-4805-9cce-2759db31106d" volumeName="kubernetes.io/projected/cd63c0ac-166d-4805-9cce-2759db31106d-kube-api-access-qzkjh" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171782    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e49a7b69-154b-44a8-b678-ee31d9bda0de" volumeName="kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-env-overrides" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171788    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e49a7b69-154b-44a8-b678-ee31d9bda0de" volumeName="kubernetes.io/secret/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171795    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1365fa77-d96f-45c6-be2e-fa85586ee67a" volumeName="kubernetes.io/configmap/1365fa77-d96f-45c6-be2e-fa85586ee67a-iptables-alerter-script" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171801    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5e10d4d3-40d6-4020-b19e-a72fecf919bc" volumeName="kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-tmp" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171814    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ee2686a-510f-46c5-a192-f39508e25e48" volumeName="kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171823    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc242644-0d8b-4303-ab8f-a495cd324938" volumeName="kubernetes.io/secret/cc242644-0d8b-4303-ab8f-a495cd324938-cert" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171835    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf1a9959-1d76-4da9-b119-9fe97b9499d5" volumeName="kubernetes.io/projected/cf1a9959-1d76-4da9-b119-9fe97b9499d5-kube-api-access-gd2b2" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171846    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e49a7b69-154b-44a8-b678-ee31d9bda0de" volumeName="kubernetes.io/projected/e49a7b69-154b-44a8-b678-ee31d9bda0de-kube-api-access-rk9lz" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171858    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7816f19-a486-4310-810e-3c8fdaf82f81" volumeName="kubernetes.io/projected/e7816f19-a486-4310-810e-3c8fdaf82f81-kube-api-access-7p2nb" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171868    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0d57b8d-62e0-4e04-af9f-4006db8324f7" volumeName="kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cni-binary-copy" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171879    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49ec8d3c-f043-4a15-9ea9-f0614f652d2c" volumeName="kubernetes.io/projected/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-kube-api-access-rjx7k" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171906    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dbb3142-eef1-4900-a295-d72dfb57eb90" volumeName="kubernetes.io/projected/4dbb3142-eef1-4900-a295-d72dfb57eb90-kube-api-access-zt26d" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171917    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="960698a0-8d7a-4451-bb9a-3da528e49130" volumeName="kubernetes.io/configmap/960698a0-8d7a-4451-bb9a-3da528e49130-serviceca" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171928    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e49a7b69-154b-44a8-b678-ee31d9bda0de" volumeName="kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171938    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc242644-0d8b-4303-ab8f-a495cd324938" volumeName="kubernetes.io/projected/cc242644-0d8b-4303-ab8f-a495cd324938-kube-api-access-tcqsh" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171947    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ee2686a-510f-46c5-a192-f39508e25e48" volumeName="kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171963    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b0ce883-a723-48cc-a887-9c9db6942a43" volumeName="kubernetes.io/projected/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-api-access-zrg97" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171973    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49ec8d3c-f043-4a15-9ea9-f0614f652d2c" volumeName="kubernetes.io/secret/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-key" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171979    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4d26948e-8d34-4cd2-bfe6-0702f4965c1b" volumeName="kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171987    4497 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5e10d4d3-40d6-4020-b19e-a72fecf919bc" volumeName="kubernetes.io/projected/5e10d4d3-40d6-4020-b19e-a72fecf919bc-kube-api-access-jxtcr" seLinuxMountContext=""
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171995    4497 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 05:49:12.172299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.171999    4497 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 05:49:12.173793 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.173774    4497 factory.go:55] Registering systemd factory
Nov 04 05:49:12.173793 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.173796    4497 factory.go:223] Registration of the systemd container factory successfully
Nov 04 05:49:12.174046 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.174028    4497 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:49:12.174101 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.174061    4497 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:34 +0000 UTC" deadline="2028-06-18 07:21:43.77702507 +0000 UTC"
Nov 04 05:49:12.174101 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.174092    4497 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14209h32m31.602936026s"
Nov 04 05:49:12.174695 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.174681    4497 factory.go:153] Registering CRI-O factory
Nov 04 05:49:12.174763 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.174697    4497 factory.go:223] Registration of the crio container factory successfully
Nov 04 05:49:12.174763 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.174754    4497 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 05:49:12.174861 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.174772    4497 factory.go:103] Registering Raw factory
Nov 04 05:49:12.174861 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.174787    4497 manager.go:1199] Started watching for new ooms in manager
Nov 04 05:49:12.175121 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.175109    4497 manager.go:319] Starting recovery of all containers
Nov 04 05:49:12.203977 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.203930    4497 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 05:49:12.205493 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.205467    4497 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 05:49:12.205493 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.205493    4497 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 05:49:12.205644 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.205547    4497 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 05:49:12.205644 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.205589    4497 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 05:49:12.247934 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.247899    4497 generic.go:356] "Generic (PLEG): container finished" podID="ac965f1cfbc1129016d728e686326ed6" containerID="e9ed2406ed18c0a13c01d82899d426678c88d12285c60b4de7e0e486ede02d36" exitCode=0
Nov 04 05:49:12.251996 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.251970    4497 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="5ded7c1564db719ea83f5cb7694af694f4b6e1c17f231686bacb1663bc20c550" exitCode=0
Nov 04 05:49:12.251996 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.251995    4497 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="fe2de4996cbc60c4fb2062b26e31b837a6964c9c13f9932889d7d5137fb92017" exitCode=0
Nov 04 05:49:12.251996 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.252001    4497 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="260411c84a88821630efbee5bdc890f2a86fe8adba34e196ffefe4225448382f" exitCode=0
Nov 04 05:49:12.252209 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.252007    4497 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="506e96fba4dede05a305511e7f5d5cd84e1f60ef6f93c5052a5196c39eb7e999" exitCode=0
Nov 04 05:49:12.252209 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.252011    4497 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="7437e3603cf45c5fa2519a435d92d2e2dad235ddc20477c029912dcd2fc1133c" exitCode=0
Nov 04 05:49:12.252209 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.252017    4497 generic.go:356] "Generic (PLEG): container finished" podID="cd63c0ac-166d-4805-9cce-2759db31106d" containerID="63cd5caddd9aeec4424b023342fe2ff48f88e28b5246801e54d041ca242c6780" exitCode=0
Nov 04 05:49:12.252322 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.252309    4497 manager.go:324] Recovery completed
Nov 04 05:49:12.267910 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.267841    4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:49:12.269262 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.269244    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:49:12.269352 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.269279    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:49:12.269352 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.269295    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:49:12.270785 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.270764    4497 cpu_manager.go:226] "Starting" policy="none"
Nov 04 05:49:12.270785 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.270780    4497 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 05:49:12.270785 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.270784    4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:49:12.270972 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.270799    4497 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 05:49:12.271021 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.270969    4497 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 05:49:12.271021 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.270986    4497 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 05:49:12.271021 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271010    4497 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 05:49:12.271021 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271018    4497 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 05:49:12.271149 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271026    4497 policy_none.go:50] "Start"
Nov 04 05:49:12.271149 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271038    4497 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 05:49:12.271149 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271052    4497 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 05:49:12.271265 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271216    4497 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 05:49:12.271265 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271228    4497 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 05:49:12.271265 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271237    4497 policy_none.go:44] "Start"
Nov 04 05:49:12.271849 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271820    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:49:12.271849 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271846    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:49:12.271998 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.271855    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:49:12.274489 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.274470    4497 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:49:12.276306 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.276283    4497 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 05:49:12.279944 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.279929    4497 manager.go:341] "Starting Device Plugin manager"
Nov 04 05:49:12.280025 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.279959    4497 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 05:49:12.280025 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.279971    4497 server.go:87] "Starting device plugin registration server"
Nov 04 05:49:12.280268 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.280252    4497 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 05:49:12.280339 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.280275    4497 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 05:49:12.281980 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.281960    4497 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 05:49:12.282099 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.282063    4497 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 05:49:12.282203 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.282111    4497 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 05:49:12.282203 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.282119    4497 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 05:49:12.282300 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.282207    4497 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:49:12.282098185Z","UUID":"293ca427-2566-40f0-b158-c96a763b62ce","Handler":null,"Name":"","Endpoint":""}
Nov 04 05:49:12.283236 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.283215    4497 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 05:49:12.283338 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.283255    4497 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-195.us-west-1.compute.internal\" not found"
Nov 04 05:49:12.283860 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.283810    4497 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 05:49:12.283860 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.283862    4497 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 05:49:12.305702 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.305667    4497 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"]
Nov 04 05:49:12.305789 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.305778    4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:49:12.306777 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.306758    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:49:12.306857 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.306793    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:49:12.306857 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.306808    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:49:12.307124 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.307107    4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:49:12.307262 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.307245    4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:49:12.308119 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308097    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:49:12.308199 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308128    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:49:12.308199 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308145    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:49:12.308456 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308419    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"c656c4baa8463ac8d24886e04ca99821","Type":"ContainerStarted","Data":"66a2cd44ba76d8cc16f8b31975ba514f1e0b07ba245d181fbe360ab9b398d23b"}
Nov 04 05:49:12.308539 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308470    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"c656c4baa8463ac8d24886e04ca99821","Type":"ContainerStarted","Data":"5bcbb5877bf8814c731412d596b75feee7ab8df7a4c6b8f0ec27a7ebc4c3155c"}
Nov 04 05:49:12.308587 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308535    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"ac965f1cfbc1129016d728e686326ed6","Type":"ContainerStarted","Data":"b83ed686a3781fccb52aaf733d253cff8ed104418425efe5a12e83b999cd5818"}
Nov 04 05:49:12.308587 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308559    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"ac965f1cfbc1129016d728e686326ed6","Type":"ContainerDied","Data":"e9ed2406ed18c0a13c01d82899d426678c88d12285c60b4de7e0e486ede02d36"}
Nov 04 05:49:12.308587 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308580    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal" event={"ID":"ac965f1cfbc1129016d728e686326ed6","Type":"ContainerStarted","Data":"037598b14878d232c87a82d475474a0024c1503a7c9b21d4377684721c914bec"}
Nov 04 05:49:12.308696 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308622    4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:49:12.308852 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308832    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:49:12.308949 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308864    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:49:12.308949 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.308878    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:49:12.309067 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.309050    4497 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.309542 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.309523    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:49:12.309604 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.309558    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:49:12.309604 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.309572    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:49:12.309732 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.309706    4497 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-195.us-west-1.compute.internal\" not found" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.375131 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.375099    4497 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:49:12.375286 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.375214    4497 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:49:12.376215 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.376115    4497 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:49:12.376215 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.376135    4497 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 05:49:12.381353 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.381331    4497 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:49:12.382623 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.382599    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:49:12.382722 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.382636    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:49:12.382722 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.382650    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:49:12.382722 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.382690    4497 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.428675 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.428652    4497 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:49:12.475089 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.475073    4497 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.477256 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.477239    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.477299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.477265    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.477299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.477283    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c656c4baa8463ac8d24886e04ca99821-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"c656c4baa8463ac8d24886e04ca99821\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.497133 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.497114    4497 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.497202 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.497163    4497 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.497656 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.497641    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeNotReady"
Nov 04 05:49:12.497734 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.497674    4497 setters.go:546] "Node became not ready" node="ip-10-0-143-195.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-04T05:49:12Z","lastTransitionTime":"2026-11-04T05:49:12Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Nov 04 05:49:12.537511 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.537459    4497 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:49:12.537511 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.537502    4497 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.537771 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.537519    4497 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.546882 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.546857    4497 nodeinfomanager.go:471] existing CSINode "ip-10-0-143-195.us-west-1.compute.internal" is owned by different node (oldNodeID="f7fd2ec8-4593-4172-93bf-2e2678014cb7", newNodeID=""), cleaning up...
Nov 04 05:49:12.578300 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.578272    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.578381 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.578303    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.578381 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.578321    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c656c4baa8463ac8d24886e04ca99821-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"c656c4baa8463ac8d24886e04ca99821\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.578381 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.578355    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c656c4baa8463ac8d24886e04ca99821-config\") pod \"kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"c656c4baa8463ac8d24886e04ca99821\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.578480 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.578376    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.578480 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.578383    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac965f1cfbc1129016d728e686326ed6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" (UID: \"ac965f1cfbc1129016d728e686326ed6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:12.596438 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:12.596419    4497 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:49:12.596497 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:12.596447    4497 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:13.152001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.151977    4497 apiserver.go:52] "Watching apiserver"
Nov 04 05:49:13.255052 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.255032    4497 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:13.255163 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.255148    4497 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:13.260363 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.260349    4497 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 05:49:13.260794 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.260775    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-wqr99","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal","openshift-multus/network-metrics-daemon-8jl2j","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8","openshift-image-registry/node-ca-mzv2m","openshift-multus/multus-jcnwk","openshift-network-operator/iptables-alerter-xzhzv","kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal","kube-system/konnectivity-agent-mkw6n","openshift-dns/dns-default-7m6nd","openshift-ingress-canary/ingress-canary-hlwlz","openshift-insights/insights-runtime-extractor-hf4w8","kube-system/global-pull-secret-syncer-86xkr","openshift-network-diagnostics/network-check-target-x4mpr","openshift-service-ca/service-ca-5fffc97bdf-cmx55","openshift-dns/node-resolver-gclqh","openshift-multus/multus-additional-cni-plugins-4f5z8","openshift-ovn-kubernetes/ovnkube-node-q4fh2","openshift-insights/periodic-gathering-smqxt-th6hc","openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"]
Nov 04 05:49:13.261706 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.261688    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:13.265508 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.265492    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.268414 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.268377    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.271281 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.271264    4497 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 05:49:13.280609 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280593    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-kubernetes\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.280653 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280616    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-run\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.280653 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280630    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-var-lib-kubelet\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.280653 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280648    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-tuned\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.280797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280722    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-tmp\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.280797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280762    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-k8s-cni-cncf-io\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.280797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280767    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-tuned\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.280797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280767    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e10d4d3-40d6-4020-b19e-a72fecf919bc-tmp\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.280942 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280822    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-config\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.280942 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280840    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk9lz\" (UniqueName: \"kubernetes.io/projected/e49a7b69-154b-44a8-b678-ee31d9bda0de-kube-api-access-rk9lz\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.280942 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280858    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0ce883-a723-48cc-a887-9c9db6942a43-data-volume\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.280942 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280896    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cnibin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.280942 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280921    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-conf-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.280942 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280929    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0ce883-a723-48cc-a887-9c9db6942a43-data-volume\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.281155 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280943    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-netns\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.281155 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280968    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-etc-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.281155 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.280984    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.281155 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281018    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-env-overrides\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.281155 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281049    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-sys-fs\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.281155 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281099    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-tmp-dir\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:49:13.281305 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281169    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-tmp-dir\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:49:13.281305 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281202    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/960698a0-8d7a-4451-bb9a-3da528e49130-serviceca\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:49:13.281305 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281231    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.281305 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281248    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2nb\" (UniqueName: \"kubernetes.io/projected/e7816f19-a486-4310-810e-3c8fdaf82f81-kube-api-access-7p2nb\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.281305 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281285    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-key\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:13.281305 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281299    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7k\" (UniqueName: \"kubernetes.io/projected/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-kube-api-access-rjx7k\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:13.281492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281315    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkjh\" (UniqueName: \"kubernetes.io/projected/cd63c0ac-166d-4805-9cce-2759db31106d-kube-api-access-qzkjh\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.281492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281333    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-kubelet-config\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:13.281492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281349    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-kubelet\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.281492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281372    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:13.281492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281427    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-binary-copy\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.281492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281474    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.281665 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281499    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-systemd\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.281665 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281517    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-multus-certs\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.281665 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281532    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-slash\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.281665 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281565    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-dbus\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:13.281665 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281590    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-modprobe-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.281665 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281614    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-conf\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.281665 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281654    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/960698a0-8d7a-4451-bb9a-3da528e49130-host\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281681    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cni-binary-copy\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281735    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-var-lib-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281797    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281824    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcqsh\" (UniqueName: \"kubernetes.io/projected/cc242644-0d8b-4303-ab8f-a495cd324938-kube-api-access-tcqsh\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281848    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt26d\" (UniqueName: \"kubernetes.io/projected/4dbb3142-eef1-4900-a295-d72dfb57eb90-kube-api-access-zt26d\") pod \"migrator-66df5d496b-cfsxx\" (UID: \"4dbb3142-eef1-4900-a295-d72dfb57eb90\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281873    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-host\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281916    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-netns\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281942    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-etc-kubernetes\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.281977    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-kubelet\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.282015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282007    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-netd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.282314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282028    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-registration-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.282314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282067    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1365fa77-d96f-45c6-be2e-fa85586ee67a-host-slash\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:49:13.282314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282100    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxtcr\" (UniqueName: \"kubernetes.io/projected/5e10d4d3-40d6-4020-b19e-a72fecf919bc-kube-api-access-jxtcr\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.282314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282167    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkbmm\" (UniqueName: \"kubernetes.io/projected/960698a0-8d7a-4451-bb9a-3da528e49130-kube-api-access-wkbmm\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:49:13.282314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282194    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-systemd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.282314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282217    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2b2\" (UniqueName: \"kubernetes.io/projected/cf1a9959-1d76-4da9-b119-9fe97b9499d5-kube-api-access-gd2b2\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.282314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282246    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc242644-0d8b-4303-ab8f-a495cd324938-cert\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:13.282314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282312    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.282534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282328    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.282534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282344    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-cabundle\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:13.282534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282359    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:13.282534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282375    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.282534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282465    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:13.282534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282493    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-lib-modules\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.282534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282511    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7pd\" (UniqueName: \"kubernetes.io/projected/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-kube-api-access-fr7pd\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:49:13.282712 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282540    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-daemon-config\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.282712 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282619    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-ovn\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.282712 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282635    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:13.282712 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282651    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-device-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.282712 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282665    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-systemd-units\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.282712 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282696    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.282865 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282726    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1a9959-1d76-4da9-b119-9fe97b9499d5-tmp-dir\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.282865 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282744    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jngrq\" (UniqueName: \"kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:13.282865 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282814    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1a9959-1d76-4da9-b119-9fe97b9499d5-tmp-dir\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.282865 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282819    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.282865 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282856    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrg97\" (UniqueName: \"kubernetes.io/projected/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-api-access-zrg97\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.283011 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282880    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-hosts-file\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:49:13.283011 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282911    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.283011 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282929    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-log-socket\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.283011 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282946    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6v4r\" (UniqueName: \"kubernetes.io/projected/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-kube-api-access-b6v4r\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:13.283011 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282962    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-socket-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.283011 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.282988    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.283196 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283048    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-sys\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.283196 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283074    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-multus\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.283196 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283099    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-node-log\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.283196 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283114    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-bin\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.283196 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283130    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.283196 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283147    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:13.283196 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283181    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:13.283368 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283208    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.283368 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283232    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:13.283368 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283248    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-bin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.283368 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283276    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-hostroot\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.283368 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283313    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-script-lib\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.283368 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283335    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1a9959-1d76-4da9-b119-9fe97b9499d5-config-volume\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.283515 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283394    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-system-cni-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.283515 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283425    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-agent-certs\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:49:13.283515 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283452    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysconfig\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.283515 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283497    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0ce883-a723-48cc-a887-9c9db6942a43-crio-socket\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.283617 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283518    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-socket-dir-parent\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.283617 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283533    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-cnibin\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.283617 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283549    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1365fa77-d96f-45c6-be2e-fa85586ee67a-iptables-alerter-script\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:49:13.283617 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283574    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swzq4\" (UniqueName: \"kubernetes.io/projected/1365fa77-d96f-45c6-be2e-fa85586ee67a-kube-api-access-swzq4\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:49:13.283719 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283640    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-system-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.283719 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283678    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4wpn\" (UniqueName: \"kubernetes.io/projected/f0d57b8d-62e0-4e04-af9f-4006db8324f7-kube-api-access-s4wpn\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.283719 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283703    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovn-node-metrics-cert\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.283796 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.283730    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-konnectivity-ca\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:49:13.317561 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.317542    4497 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:49:13.317610 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.317581    4497 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:13.318009 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.317994    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 05:49:13.318060 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318004    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 05:49:13.318060 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318034    4497 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:49:13.318060 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318047    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mrpf\""
Nov 04 05:49:13.318154 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.318073    4497 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-195.us-west-1.compute.internal"
Nov 04 05:49:13.318437 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318417    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lflbx\""
Nov 04 05:49:13.318500 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318418    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8frb\""
Nov 04 05:49:13.318500 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318430    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5jcm9\""
Nov 04 05:49:13.318500 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318437    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-tk5dx\""
Nov 04 05:49:13.318500 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318449    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mpd4s\""
Nov 04 05:49:13.318500 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.318484    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv6vj\""
Nov 04 05:49:13.321822 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.321803    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.321945 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.321881    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 05:49:13.321945 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.321930    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.322050 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322018    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.322050 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322028    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.322050 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322046    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.322197 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322051    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.322197 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322082    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.322197 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322091    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qt7t9\""
Nov 04 05:49:13.322197 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322099    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 05:49:13.322197 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322169    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.322197 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322194    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.322385 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322279    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 05:49:13.322385 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322319    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.322512 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322497    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.322512 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322507    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.322616 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322516    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.322616 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322535    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 05:49:13.322616 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322548    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 05:49:13.322733 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322650    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 05:49:13.322877 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.322863    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-daemon-config\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.323591 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.323578    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-script-lib\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.324692 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.324677    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1365fa77-d96f-45c6-be2e-fa85586ee67a-iptables-alerter-script\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:49:13.331823 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.331803    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovnkube-config\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.331823 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.331820    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-binary-copy\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.331944 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.331807    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/960698a0-8d7a-4451-bb9a-3da528e49130-serviceca\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:49:13.331944 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.331871    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cni-binary-copy\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.370337 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.370307    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2b2\" (UniqueName: \"kubernetes.io/projected/cf1a9959-1d76-4da9-b119-9fe97b9499d5-kube-api-access-gd2b2\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.370957 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.370937    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7pd\" (UniqueName: \"kubernetes.io/projected/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-kube-api-access-fr7pd\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:49:13.371327 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.371310    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkjh\" (UniqueName: \"kubernetes.io/projected/cd63c0ac-166d-4805-9cce-2759db31106d-kube-api-access-qzkjh\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.371458 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.371434    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4wpn\" (UniqueName: \"kubernetes.io/projected/f0d57b8d-62e0-4e04-af9f-4006db8324f7-kube-api-access-s4wpn\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.371503 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.371424    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6v4r\" (UniqueName: \"kubernetes.io/projected/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-kube-api-access-b6v4r\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:13.371697 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.371683    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkbmm\" (UniqueName: \"kubernetes.io/projected/960698a0-8d7a-4451-bb9a-3da528e49130-kube-api-access-wkbmm\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:49:13.372107 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.372093    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swzq4\" (UniqueName: \"kubernetes.io/projected/1365fa77-d96f-45c6-be2e-fa85586ee67a-kube-api-access-swzq4\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:49:13.375591 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.375576    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5wfm\" (UniqueName: \"kubernetes.io/projected/8ca4017d-de12-4d9f-be61-b1a5aeaea9ef-kube-api-access-d5wfm\") pod \"network-check-target-x4mpr\" (UID: \"8ca4017d-de12-4d9f-be61-b1a5aeaea9ef\") " pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:13.375945 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.375929    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2nb\" (UniqueName: \"kubernetes.io/projected/e7816f19-a486-4310-810e-3c8fdaf82f81-kube-api-access-7p2nb\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.384494 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384479    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.384599 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384500    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.384599 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384518    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-lib-modules\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.384599 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384532    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-ovn\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.384599 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384546    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:13.384599 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384590    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-device-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384596    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384593    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-ovn\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384625    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-device-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384629    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-systemd-units\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384656    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-lib-modules\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.384688    4497 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384727    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-systemd-units\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.384775    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.884756991 +0000 UTC m=+1.815954380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : secret "metrics-daemon-secret" not found
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384797    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384831    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.384836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384836    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384855    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-hosts-file\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384878    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384924    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8138b678-e6cc-4bb6-9ab6-5b26e8963b25-hosts-file\") pod \"node-resolver-gclqh\" (UID: \"8138b678-e6cc-4bb6-9ab6-5b26e8963b25\") " pod="openshift-dns/node-resolver-gclqh"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384923    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-log-socket\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384952    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-socket-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384959    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-log-socket\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384976    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.384999    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-sys\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385002    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385024    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-multus\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385019    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-socket-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385048    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-node-log\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385061    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-sys\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385068    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-bin\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385078    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-multus\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385089    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385106    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385093    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-node-log\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385118    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385121    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-bin\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385126    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385145    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-bin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385162    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-hostroot\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385175    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-cni-bin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385183    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-system-cni-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385196    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-hostroot\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385206    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-system-cni-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385224    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysconfig\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385247    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0ce883-a723-48cc-a887-9c9db6942a43-crio-socket\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385262    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-socket-dir-parent\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385279    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-cnibin\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385305    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-system-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385321    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0ce883-a723-48cc-a887-9c9db6942a43-crio-socket\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385330    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-kubernetes\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385337    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-cnibin\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385351    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-run\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385358    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysconfig\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385369    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-system-cni-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385374    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-var-lib-kubelet\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385381    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-kubernetes\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385386    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-run\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.385365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385350    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-socket-dir-parent\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385402    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-k8s-cni-cncf-io\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385421    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cnibin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385423    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-var-lib-kubelet\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385429    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-k8s-cni-cncf-io\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385438    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-conf-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385466    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-netns\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385475    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-cnibin\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385492    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-multus-conf-dir\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385499    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-netns\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385495    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-etc-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385514    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-etc-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385530    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385555    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-sys-fs\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385565    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385577    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385594    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-kubelet-config\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385614    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-kubelet\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385618    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385594    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-sys-fs\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385640    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385656    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-kubelet-config\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385664    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-var-lib-kubelet\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385664    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-systemd\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385704    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-multus-certs\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385712    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd63c0ac-166d-4805-9cce-2759db31106d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385715    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-systemd\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385727    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-slash\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385750    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-dbus\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385766    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-modprobe-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385775    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-multus-certs\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385781    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-conf\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385799    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/960698a0-8d7a-4451-bb9a-3da528e49130-host\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385823    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-var-lib-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385818    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-dbus\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385842    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-slash\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385846    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-host\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385880    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-netns\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385899    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-host\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385864    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-modprobe-d\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385923    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-var-lib-openvswitch\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385930    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e10d4d3-40d6-4020-b19e-a72fecf919bc-etc-sysctl-conf\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385881    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/960698a0-8d7a-4451-bb9a-3da528e49130-host\") pod \"node-ca-mzv2m\" (UID: \"960698a0-8d7a-4451-bb9a-3da528e49130\") " pod="openshift-image-registry/node-ca-mzv2m"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385932    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-host-run-netns\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385945    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-etc-kubernetes\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385965    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d57b8d-62e0-4e04-af9f-4006db8324f7-etc-kubernetes\") pod \"multus-jcnwk\" (UID: \"f0d57b8d-62e0-4e04-af9f-4006db8324f7\") " pod="openshift-multus/multus-jcnwk"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385966    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-kubelet\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385995    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-netd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.385990    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-kubelet\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.386014    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-registration-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.386030    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1365fa77-d96f-45c6-be2e-fa85586ee67a-host-slash\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.386037    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-host-cni-netd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.386046    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-systemd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.386080    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1365fa77-d96f-45c6-be2e-fa85586ee67a-host-slash\") pod \"iptables-alerter-xzhzv\" (UID: \"1365fa77-d96f-45c6-be2e-fa85586ee67a\") " pod="openshift-network-operator/iptables-alerter-xzhzv"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.386094    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49a7b69-154b-44a8-b678-ee31d9bda0de-run-systemd\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.386597 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.386101    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7816f19-a486-4310-810e-3c8fdaf82f81-registration-dir\") pod \"aws-ebs-csi-driver-node-9ssk8\" (UID: \"e7816f19-a486-4310-810e-3c8fdaf82f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9ssk8"
Nov 04 05:49:13.417987 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.417908    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.418102 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418087    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.418102 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418094    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 05:49:13.418219 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418104    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dhhmg\""
Nov 04 05:49:13.418219 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418149    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.418219 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418191    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 05:49:13.418372 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418265    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.418372 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418298    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.418372 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418323    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 05:49:13.418372 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418346    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418383    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418418    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418420    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418428    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418427    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-njggn\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418454    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418457    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418475    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-58k5t\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418487    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418510    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418518    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418509    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-plv46\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418552    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.418565 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418569    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 05:49:13.419115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418604    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8z5zb\""
Nov 04 05:49:13.419115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418612    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 05:49:13.419115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418808    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6xqtp\""
Nov 04 05:49:13.419115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418855    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gcv4b\""
Nov 04 05:49:13.419115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.418992    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7wx5\""
Nov 04 05:49:13.419115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.419012    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 04 05:49:13.419115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.419047    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 05:49:13.419115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.419085    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 05:49:13.419347 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.419121    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwct4\""
Nov 04 05:49:13.419347 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.419211    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rt5s6\""
Nov 04 05:49:13.419347 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.419263    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 05:49:13.419347 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.419297    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 05:49:13.420516 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.420502    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxtcr\" (UniqueName: \"kubernetes.io/projected/5e10d4d3-40d6-4020-b19e-a72fecf919bc-kube-api-access-jxtcr\") pod \"tuned-wqr99\" (UID: \"5e10d4d3-40d6-4020-b19e-a72fecf919bc\") " pod="openshift-cluster-node-tuning-operator/tuned-wqr99"
Nov 04 05:49:13.421441 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.421423    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e49a7b69-154b-44a8-b678-ee31d9bda0de-env-overrides\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.421596 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.421578    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-key\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:13.421760 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.421745    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt26d\" (UniqueName: \"kubernetes.io/projected/4dbb3142-eef1-4900-a295-d72dfb57eb90-kube-api-access-zt26d\") pod \"migrator-66df5d496b-cfsxx\" (UID: \"4dbb3142-eef1-4900-a295-d72dfb57eb90\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cfsxx"
Nov 04 05:49:13.421812 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.421781    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrg97\" (UniqueName: \"kubernetes.io/projected/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-api-access-zrg97\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.421946 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.421933    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjx7k\" (UniqueName: \"kubernetes.io/projected/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-kube-api-access-rjx7k\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:13.421986 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.421968    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcqsh\" (UniqueName: \"kubernetes.io/projected/cc242644-0d8b-4303-ab8f-a495cd324938-kube-api-access-tcqsh\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:13.422015 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.421982    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jngrq\" (UniqueName: \"kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:13.422063 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.422051    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.422498 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.422484    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc242644-0d8b-4303-ab8f-a495cd324938-cert\") pod \"ingress-canary-hlwlz\" (UID: \"cc242644-0d8b-4303-ab8f-a495cd324938\") " pod="openshift-ingress-canary/ingress-canary-hlwlz"
Nov 04 05:49:13.422556 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.422545    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49ec8d3c-f043-4a15-9ea9-f0614f652d2c-signing-cabundle\") pod \"service-ca-5fffc97bdf-cmx55\" (UID: \"49ec8d3c-f043-4a15-9ea9-f0614f652d2c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55"
Nov 04 05:49:13.422590 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.422570    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd63c0ac-166d-4805-9cce-2759db31106d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4f5z8\" (UID: \"cd63c0ac-166d-4805-9cce-2759db31106d\") " pod="openshift-multus/multus-additional-cni-plugins-4f5z8"
Nov 04 05:49:13.422697 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.422682    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d26948e-8d34-4cd2-bfe6-0702f4965c1b-original-pull-secret\") pod \"global-pull-secret-syncer-86xkr\" (UID: \"4d26948e-8d34-4cd2-bfe6-0702f4965c1b\") " pod="kube-system/global-pull-secret-syncer-86xkr"
Nov 04 05:49:13.423459 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.423443    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:13.423517 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.423504    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1a9959-1d76-4da9-b119-9fe97b9499d5-config-volume\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.424206 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.424189    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e49a7b69-154b-44a8-b678-ee31d9bda0de-ovn-node-metrics-cert\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.424206 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.424203    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-konnectivity-ca\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:49:13.424295 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.424278    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84b61b57-97fa-42cd-a376-cd9d9d78eeaa-agent-certs\") pod \"konnectivity-agent-mkw6n\" (UID: \"84b61b57-97fa-42cd-a376-cd9d9d78eeaa\") " pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:49:13.426865 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.424922    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 05:49:13.426865 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.424981    4497 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:13.426865 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.425027    4497 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:13.426865 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.425089    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.925068687 +0000 UTC m=+1.856266126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:13.426865 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.425120    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.925102964 +0000 UTC m=+1.856300369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:13.426865 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.426843    4497 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:49:13.427266 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.427252    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:13.92723213 +0000 UTC m=+1.858429544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : configmap "kube-rbac-proxy" not found
Nov 04 05:49:13.427537 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.427522    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk9lz\" (UniqueName: \"kubernetes.io/projected/e49a7b69-154b-44a8-b678-ee31d9bda0de-kube-api-access-rk9lz\") pod \"ovnkube-node-q4fh2\" (UID: \"e49a7b69-154b-44a8-b678-ee31d9bda0de\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:13.432059 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.431993    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle\") pod \"periodic-gathering-smqxt-th6hc\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") " pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:49:13.570342 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.570327    4497 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:49:13.890704 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.890675    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:13.890840 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.890820    4497 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 05:49:13.890910 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.890897    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.890871549 +0000 UTC m=+2.822068936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : secret "metrics-daemon-secret" not found
Nov 04 05:49:13.991375 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.991314    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:13.991375 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.991352    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.991514 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:13.991375    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:13.991514 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.991441    4497 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:49:13.991514 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.991441    4497 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:13.991514 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.991459    4497 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:13.991514 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.991491    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.991479747 +0000 UTC m=+2.922677122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:13.991514 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.991509    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.991498936 +0000 UTC m=+2.922696313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : configmap "kube-rbac-proxy" not found
Nov 04 05:49:13.991695 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:13.991520    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:14.991515218 +0000 UTC m=+2.922712593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:14.059610 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:14.059588    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:14.897502 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:14.897469    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:14.897945 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:14.897624    4497 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 05:49:14.897945 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:14.897688    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.897671746 +0000 UTC m=+4.828869137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : secret "metrics-daemon-secret" not found
Nov 04 05:49:14.998257 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:14.998227    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:14.998438 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:14.998287    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:14.998438 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:14.998321    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:14.998438 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:14.998410    4497 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:14.998587 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:14.998483    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.998463097 +0000 UTC m=+4.929660486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:14.998587 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:14.998543    4497 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:14.998690 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:14.998600    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:16.998583987 +0000 UTC m=+4.929781386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:14.998940 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:14.998914    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0ce883-a723-48cc-a887-9c9db6942a43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:15.261587 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:15.261507    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-smqxt-th6hc" event={"ID":"6ee2686a-510f-46c5-a192-f39508e25e48","Type":"ContainerStarted","Data":"5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a"}
Nov 04 05:49:15.268016 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:15.267986    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:16.911303 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:16.911248    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:16.911652 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:16.911394    4497 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 05:49:16.911652 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:16.911458    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.911440667 +0000 UTC m=+8.842638053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : secret "metrics-daemon-secret" not found
Nov 04 05:49:17.012028 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:17.012000    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:17.012164 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:17.012045    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:17.012164 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:17.012158    4497 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:17.012233 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:17.012158    4497 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:49:17.012233 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:17.012221    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:21.01220633 +0000 UTC m=+8.943403707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:17.012298 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:17.012236    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls podName:cf1a9959-1d76-4da9-b119-9fe97b9499d5 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:21.012230018 +0000 UTC m=+8.943427393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls") pod "dns-default-7m6nd" (UID: "cf1a9959-1d76-4da9-b119-9fe97b9499d5") : secret "dns-default-metrics-tls" not found
Nov 04 05:49:17.267311 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:17.267243    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-cmx55" event={"ID":"49ec8d3c-f043-4a15-9ea9-f0614f652d2c","Type":"ContainerStarted","Data":"e9b33e8ce83094a66e567a8e0ceccec8376d28acb16782e5eef7c18c28ed0d18"}
Nov 04 05:49:18.477098 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:18.477063    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gclqh_8138b678-e6cc-4bb6-9ab6-5b26e8963b25/dns-node-resolver/0.log"
Nov 04 05:49:19.183065 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:19.183038    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mzv2m_960698a0-8d7a-4451-bb9a-3da528e49130/node-ca/0.log"
Nov 04 05:49:19.482736 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:19.482670    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:19.483077 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:19.482868    4497 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:49:19.783832 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:19.783766    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hlwlz_cc242644-0d8b-4303-ab8f-a495cd324938/serve-healthcheck-canary/0.log"
Nov 04 05:49:20.184400 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:20.184374    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-cfsxx_4dbb3142-eef1-4900-a295-d72dfb57eb90/migrator/0.log"
Nov 04 05:49:20.939911 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:20.939865    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:20.940258 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:20.940005    4497 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 05:49:20.940258 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:20.940075    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs podName:8c2a2e06-d054-47ef-a4c9-d4f7a76009a0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:28.94005954 +0000 UTC m=+16.871256937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs") pod "network-metrics-daemon-8jl2j" (UID: "8c2a2e06-d054-47ef-a4c9-d4f7a76009a0") : secret "metrics-daemon-secret" not found
Nov 04 05:49:21.040748 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:21.040715    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:21.040865 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:21.040760    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:21.040865 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:21.040847    4497 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:21.040956 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:21.040916    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls podName:2b0ce883-a723-48cc-a887-9c9db6942a43 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:29.040904421 +0000 UTC m=+16.972101796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hf4w8" (UID: "2b0ce883-a723-48cc-a887-9c9db6942a43") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:49:21.041134 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:21.041115    4497 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 05:49:21.043206 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:21.043179    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a9959-1d76-4da9-b119-9fe97b9499d5-metrics-tls\") pod \"dns-default-7m6nd\" (UID: \"cf1a9959-1d76-4da9-b119-9fe97b9499d5\") " pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:21.066253 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:21.066231    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:21.439774 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:21.439746    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7m6nd"]
Nov 04 05:49:21.443768 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:21.443742    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1a9959_1d76_4da9_b119_9fe97b9499d5.slice/crio-142dce0a653f442de09d0fc04b5ba87846e37d103656a9b90c84a01bdfd14fc4 WatchSource:0}: Error finding container 142dce0a653f442de09d0fc04b5ba87846e37d103656a9b90c84a01bdfd14fc4: Status 404 returned error can't find the container with id 142dce0a653f442de09d0fc04b5ba87846e37d103656a9b90c84a01bdfd14fc4
Nov 04 05:49:21.629180 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:21.629156    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4fh2"
Nov 04 05:49:22.280200 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:22.280133    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7m6nd" event={"ID":"cf1a9959-1d76-4da9-b119-9fe97b9499d5","Type":"ContainerStarted","Data":"142dce0a653f442de09d0fc04b5ba87846e37d103656a9b90c84a01bdfd14fc4"}
Nov 04 05:49:22.474258 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:22.474207    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:22.575378 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:22.575319    4497 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-195.us-west-1.compute.internal" event="NodeReady"
Nov 04 05:49:22.726634 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:22.726598    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:22.868781 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:22.868737    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:23.010869 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:23.010832    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:23.875660 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:23.875627    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:24.072797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:24.072763    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:24.276304 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:24.276241    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:24.286783 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:24.286754    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7m6nd" event={"ID":"cf1a9959-1d76-4da9-b119-9fe97b9499d5","Type":"ContainerStarted","Data":"0e21eab1bcf1a658bced39ca799abcd76d94e79fb79bccc33220d49fd0b1338f"}
Nov 04 05:49:24.286907 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:24.286800    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7m6nd" event={"ID":"cf1a9959-1d76-4da9-b119-9fe97b9499d5","Type":"ContainerStarted","Data":"06eb221f95616f556468ec06c114a2a2e4f121ca832585ccdbbf34384e8a119f"}
Nov 04 05:49:24.286907 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:24.286834    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:24.514557 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:24.514527    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:24.676773 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:24.676746    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:25.882974 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:25.882937    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:26.078690 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:26.078658    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:26.276569 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:26.276505    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:26.473464 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:26.473435    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:26.675559 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:26.675535    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:27.874970 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:27.874938    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:28.075278 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:28.075252    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:28.272604 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:28.272534    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:28.486142 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:28.486114    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:28.674268 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:28.674240    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:28.993790 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:28.993731    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:28.996098 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:28.996075    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2a2e06-d054-47ef-a4c9-d4f7a76009a0-metrics-certs\") pod \"network-metrics-daemon-8jl2j\" (UID: \"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0\") " pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:29.093986 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:29.093959    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:29.096045 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:29.096024    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0ce883-a723-48cc-a887-9c9db6942a43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hf4w8\" (UID: \"2b0ce883-a723-48cc-a887-9c9db6942a43\") " pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:29.162233 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:29.162208    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jl2j"
Nov 04 05:49:29.169949 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:29.169924    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hf4w8"
Nov 04 05:49:29.536651 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:29.536624    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8jl2j"]
Nov 04 05:49:29.583539 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:29.583512    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2a2e06_d054_47ef_a4c9_d4f7a76009a0.slice/crio-bd9082335cffdc08d83576645865218bfbd3083bf01e24413a821d3cdd79166f WatchSource:0}: Error finding container bd9082335cffdc08d83576645865218bfbd3083bf01e24413a821d3cdd79166f: Status 404 returned error can't find the container with id bd9082335cffdc08d83576645865218bfbd3083bf01e24413a821d3cdd79166f
Nov 04 05:49:29.593201 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:29.593180    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hf4w8"]
Nov 04 05:49:29.596327 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:29.596307    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0ce883_a723_48cc_a887_9c9db6942a43.slice/crio-d477a3ff1e38d0f93b065c3f315862d9b2ac24bb06093eb22201ee717c979965 WatchSource:0}: Error finding container d477a3ff1e38d0f93b065c3f315862d9b2ac24bb06093eb22201ee717c979965: Status 404 returned error can't find the container with id d477a3ff1e38d0f93b065c3f315862d9b2ac24bb06093eb22201ee717c979965
Nov 04 05:49:29.808766 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:29.808705    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mkw6n"
Nov 04 05:49:30.307107 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:30.307075    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hf4w8" event={"ID":"2b0ce883-a723-48cc-a887-9c9db6942a43","Type":"ContainerStarted","Data":"03686b406ed8e465afb47509aaff4c64be48ab4d546c5c0778ce6f1da07a8218"}
Nov 04 05:49:30.307477 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:30.307133    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hf4w8" event={"ID":"2b0ce883-a723-48cc-a887-9c9db6942a43","Type":"ContainerStarted","Data":"d477a3ff1e38d0f93b065c3f315862d9b2ac24bb06093eb22201ee717c979965"}
Nov 04 05:49:30.308119 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:30.308102    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jl2j" event={"ID":"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0","Type":"ContainerStarted","Data":"bd9082335cffdc08d83576645865218bfbd3083bf01e24413a821d3cdd79166f"}
Nov 04 05:49:31.313419 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:31.313353    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hf4w8" event={"ID":"2b0ce883-a723-48cc-a887-9c9db6942a43","Type":"ContainerStarted","Data":"5919bcd1bdb0537a90ca0cb6fbe6a4cde753326af7d74ce837e50167a02d2c72"}
Nov 04 05:49:31.318114 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:31.318087    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jl2j" event={"ID":"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0","Type":"ContainerStarted","Data":"4f5753e4f150deaf8be4a1183e9b8aeb1e3ee5365b0c258eb18b1e2d79214259"}
Nov 04 05:49:31.318252 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:31.318150    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jl2j" event={"ID":"8c2a2e06-d054-47ef-a4c9-d4f7a76009a0","Type":"ContainerStarted","Data":"1d7cd89ab5d6429b02287a48107d2afcb38285f07dc1deb802214fe2e0cf67bd"}
Nov 04 05:49:32.788959 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.788931    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57c9c46db9-lspgn"]
Nov 04 05:49:32.790723 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.790708    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.823063 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.823038    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89fm5\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-kube-api-access-89fm5\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.823164 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.823074    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-registry-tls\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.823164 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.823090    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa53155b-5464-4498-a449-24f41b0e15fd-installation-pull-secrets\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.823164 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.823107    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa53155b-5464-4498-a449-24f41b0e15fd-ca-trust-extracted\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.823164 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.823155    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-bound-sa-token\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.823310 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.823290    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa53155b-5464-4498-a449-24f41b0e15fd-image-registry-private-configuration\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.823341 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.823324    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa53155b-5464-4498-a449-24f41b0e15fd-trusted-ca\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.823371 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.823343    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa53155b-5464-4498-a449-24f41b0e15fd-registry-certificates\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.843486 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.843465    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:32.845552 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.845535    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 04 05:49:32.898376 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.898357    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5ph5l\""
Nov 04 05:49:32.923186 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.923162    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 04 05:49:32.924375 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924356    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89fm5\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-kube-api-access-89fm5\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.924420 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924393    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-registry-tls\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.924420 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924411    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa53155b-5464-4498-a449-24f41b0e15fd-installation-pull-secrets\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.924480 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924427    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa53155b-5464-4498-a449-24f41b0e15fd-ca-trust-extracted\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.924480 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924444    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-bound-sa-token\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.924559 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924476    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa53155b-5464-4498-a449-24f41b0e15fd-image-registry-private-configuration\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.924559 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924505    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa53155b-5464-4498-a449-24f41b0e15fd-trusted-ca\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.924559 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924533    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa53155b-5464-4498-a449-24f41b0e15fd-registry-certificates\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.924861 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.924838    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa53155b-5464-4498-a449-24f41b0e15fd-ca-trust-extracted\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.925272 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.925256    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa53155b-5464-4498-a449-24f41b0e15fd-registry-certificates\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.926813 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.926794    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa53155b-5464-4498-a449-24f41b0e15fd-installation-pull-secrets\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.926952 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.926937    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa53155b-5464-4498-a449-24f41b0e15fd-image-registry-private-configuration\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.950438 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.950414    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 04 05:49:32.957156 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.957139    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-registry-tls\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.976073 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.976053    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 04 05:49:32.985652 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.985623    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa53155b-5464-4498-a449-24f41b0e15fd-trusted-ca\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.990670 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.990649    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57c9c46db9-lspgn"]
Nov 04 05:49:32.992214 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.992196    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-bound-sa-token\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:32.992540 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:32.992521    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89fm5\" (UniqueName: \"kubernetes.io/projected/aa53155b-5464-4498-a449-24f41b0e15fd-kube-api-access-89fm5\") pod \"image-registry-57c9c46db9-lspgn\" (UID: \"aa53155b-5464-4498-a449-24f41b0e15fd\") " pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:33.000953 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:33.000932    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:33.100268 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:33.100245    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:33.325770 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:33.325739    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hf4w8" event={"ID":"2b0ce883-a723-48cc-a887-9c9db6942a43","Type":"ContainerStarted","Data":"2a15e47daf3f4e0f8072bb6208fdb14dbd11e74da1c9a03510db4e4ea0de89fc"}
Nov 04 05:49:33.443700 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:33.443639    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:33.584040 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:33.584012    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57c9c46db9-lspgn"]
Nov 04 05:49:33.627252 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:33.627227    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa53155b_5464_4498_a449_24f41b0e15fd.slice/crio-d7c857931afa3ed1ded2fa01c446bd9f790ad28604940f442fa84492dcc76a37 WatchSource:0}: Error finding container d7c857931afa3ed1ded2fa01c446bd9f790ad28604940f442fa84492dcc76a37: Status 404 returned error can't find the container with id d7c857931afa3ed1ded2fa01c446bd9f790ad28604940f442fa84492dcc76a37
Nov 04 05:49:33.642165 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:33.642117    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:33.838960 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:33.838929    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:33.997650 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:33.997611    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:34.294760 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:34.294680    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7m6nd"
Nov 04 05:49:34.330608 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:34.330572    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57c9c46db9-lspgn" event={"ID":"aa53155b-5464-4498-a449-24f41b0e15fd","Type":"ContainerStarted","Data":"4ebc080669bb89ce1e98896de00e3743c8c27d23f95d2a93199092c491554737"}
Nov 04 05:49:34.330746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:34.330622    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57c9c46db9-lspgn" event={"ID":"aa53155b-5464-4498-a449-24f41b0e15fd","Type":"ContainerStarted","Data":"d7c857931afa3ed1ded2fa01c446bd9f790ad28604940f442fa84492dcc76a37"}
Nov 04 05:49:34.542345 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:34.542293    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57c9c46db9-lspgn" podStartSLOduration=2.54227934 podStartE2EDuration="2.54227934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:34.541744218 +0000 UTC m=+22.472941626" watchObservedRunningTime="2026-11-04 05:49:34.54227934 +0000 UTC m=+22.473476736"
Nov 04 05:49:34.713192 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:34.713157    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:34.912970 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:34.912932    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:35.333354 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:35.333328    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:36.328738 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:36.328703    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:36.478137 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:36.478098    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:39.023090 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:39.023056    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:39.169427 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:39.169394    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:39.312808 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:39.312738    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:39.522611 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:39.522579    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:43.325717 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:49:43.325686    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:49:43.587986 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:43.587954    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:43.728176 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:43.728146    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:44.420751 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:44.420713    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:44.565362 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:44.565334    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:44.717986 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:44.717913    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:44.959013 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:44.958982    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:45.103432 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.103396    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:45.246382 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.246346    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:45.271213 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.271188    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x4mpr"
Nov 04 05:49:45.325000 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.324970    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s4mm4"]
Nov 04 05:49:45.367156 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.367091    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408003 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.407969    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmk4f\" (UniqueName: \"kubernetes.io/projected/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-kube-api-access-dmk4f\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408142 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.408020    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408142 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.408122    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-wtmp\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408272 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.408149    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-sys\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408272 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.408165    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-tls\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408272 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.408181    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-root\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408272 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.408205    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408539 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.408318    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-metrics-client-ca\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.408539 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.408353    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-textfile\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.417033 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.417012    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:45.467255 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.467197    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tjrmr\""
Nov 04 05:49:45.467665 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.467269    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 05:49:45.493734 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.493712    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 05:49:45.493964 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.493822    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 05:49:45.493964 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.493827    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 05:49:45.493964 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.493920    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 05:49:45.493964 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.493957    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 05:49:45.509655 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509636    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmk4f\" (UniqueName: \"kubernetes.io/projected/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-kube-api-access-dmk4f\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.509771 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509666    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.509771 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509688    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-wtmp\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.509771 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509703    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-sys\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.509771 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509722    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-tls\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.509771 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509746    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-root\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510023 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509773    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510023 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509804    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-metrics-client-ca\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510023 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509806    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-sys\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510023 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509853    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-wtmp\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510023 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509874    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-root\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510023 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.509924    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-textfile\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510347 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.510325    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-textfile\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510507 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.510489    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.510673 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.510652    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-metrics-client-ca\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.512132 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.512113    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.512132 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.512125    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-node-exporter-tls\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.561430 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.561404    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:45.572288 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.572266    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmk4f\" (UniqueName: \"kubernetes.io/projected/8f7b2325-a9f4-41a2-8feb-203f6a4cee09-kube-api-access-dmk4f\") pod \"node-exporter-s4mm4\" (UID: \"8f7b2325-a9f4-41a2-8feb-203f6a4cee09\") " pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.706976 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.706873    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:45.717820 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:45.717794    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4mm4"
Nov 04 05:49:45.749083 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:45.749062    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7b2325_a9f4_41a2_8feb_203f6a4cee09.slice/crio-b5eb01d9660ad69b9d66c32c4593fd2c0456bfde026602f02af1fe934c9ec0a9 WatchSource:0}: Error finding container b5eb01d9660ad69b9d66c32c4593fd2c0456bfde026602f02af1fe934c9ec0a9: Status 404 returned error can't find the container with id b5eb01d9660ad69b9d66c32c4593fd2c0456bfde026602f02af1fe934c9ec0a9
Nov 04 05:49:46.365605 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:46.365576    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4mm4" event={"ID":"8f7b2325-a9f4-41a2-8feb-203f6a4cee09","Type":"ContainerStarted","Data":"b5eb01d9660ad69b9d66c32c4593fd2c0456bfde026602f02af1fe934c9ec0a9"}
Nov 04 05:49:46.655300 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:46.654575    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:46.882618 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:46.882577    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:47.584590 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:47.584557    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:48.028428 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.028395    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"]
Nov 04 05:49:48.030749 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.030733    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.051321 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.051301    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"]
Nov 04 05:49:48.103190 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.103141    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 04 05:49:48.103190 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.103142    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 04 05:49:48.103190 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.103162    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 04 05:49:48.103366 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.103189    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 04 05:49:48.103366 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.103227    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 04 05:49:48.103366 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.103241    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-493pf8kh574ap\""
Nov 04 05:49:48.103366 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.103311    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qngwm\""
Nov 04 05:49:48.129172 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129153    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.129240 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129189    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-grpc-tls\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.129240 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129209    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-tls\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.129240 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129226    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be6ce23-8666-4c97-b82b-10b27c56a9b6-tmp\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.129324 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129311    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh4rz\" (UniqueName: \"kubernetes.io/projected/6be6ce23-8666-4c97-b82b-10b27c56a9b6-kube-api-access-bh4rz\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.129381 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129368    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6be6ce23-8666-4c97-b82b-10b27c56a9b6-metrics-client-ca\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.129418 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129392    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.129418 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129409    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.129473 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.129429    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230388 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230369    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230485 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230406    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-grpc-tls\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230485 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230426    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-tls\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230485 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230445    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be6ce23-8666-4c97-b82b-10b27c56a9b6-tmp\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230485 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230466    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh4rz\" (UniqueName: \"kubernetes.io/projected/6be6ce23-8666-4c97-b82b-10b27c56a9b6-kube-api-access-bh4rz\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230747 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230594    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6be6ce23-8666-4c97-b82b-10b27c56a9b6-metrics-client-ca\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230747 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230641    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230747 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230669    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230747 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230704    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.230962 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.230932    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be6ce23-8666-4c97-b82b-10b27c56a9b6-tmp\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.231506 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.231474    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6be6ce23-8666-4c97-b82b-10b27c56a9b6-metrics-client-ca\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.233336 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.233273    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-tls\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.233336 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.233298    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-grpc-tls\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.233483 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.233377    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.233483 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.233444    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.233668 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.233648    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.233776 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.233756    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6be6ce23-8666-4c97-b82b-10b27c56a9b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.293669 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.293615    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh4rz\" (UniqueName: \"kubernetes.io/projected/6be6ce23-8666-4c97-b82b-10b27c56a9b6-kube-api-access-bh4rz\") pod \"thanos-querier-5f88b7fb75-c5sq8\" (UID: \"6be6ce23-8666-4c97-b82b-10b27c56a9b6\") " pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.326456 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.326430    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:48.345411 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.345390    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:48.373692 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.373669    4497 generic.go:356] "Generic (PLEG): container finished" podID="8f7b2325-a9f4-41a2-8feb-203f6a4cee09" containerID="36e6036bc2d2391e44d28d9df41922ded9de0a9bb6a751b4f730456b3eec6f13" exitCode=0
Nov 04 05:49:48.373792 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.373737    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4mm4" event={"ID":"8f7b2325-a9f4-41a2-8feb-203f6a4cee09","Type":"ContainerDied","Data":"36e6036bc2d2391e44d28d9df41922ded9de0a9bb6a751b4f730456b3eec6f13"}
Nov 04 05:49:48.468568 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.468537    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:48.651103 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.651070    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:48.780915 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:48.780549    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"]
Nov 04 05:49:48.784439 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:49:48.784414    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be6ce23_8666_4c97_b82b_10b27c56a9b6.slice/crio-b453a6df0a6328a40e7cedcaaa4e78031d1d12cd1ef17cb73ab8bcf9dc21aa5a WatchSource:0}: Error finding container b453a6df0a6328a40e7cedcaaa4e78031d1d12cd1ef17cb73ab8bcf9dc21aa5a: Status 404 returned error can't find the container with id b453a6df0a6328a40e7cedcaaa4e78031d1d12cd1ef17cb73ab8bcf9dc21aa5a
Nov 04 05:49:49.378011 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:49.377972    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8" event={"ID":"6be6ce23-8666-4c97-b82b-10b27c56a9b6","Type":"ContainerStarted","Data":"b453a6df0a6328a40e7cedcaaa4e78031d1d12cd1ef17cb73ab8bcf9dc21aa5a"}
Nov 04 05:49:49.380137 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:49.380113    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4mm4" event={"ID":"8f7b2325-a9f4-41a2-8feb-203f6a4cee09","Type":"ContainerStarted","Data":"591dabc1a865beff778cb8872a2f76baa0b98e9ecd78b4ddc8a7e7cea216a1e8"}
Nov 04 05:49:49.380264 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:49.380154    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4mm4" event={"ID":"8f7b2325-a9f4-41a2-8feb-203f6a4cee09","Type":"ContainerStarted","Data":"0b43bf9015bcf45654aec093118b88e092e2c35e76dac352ec57e0ec8ee6934d"}
Nov 04 05:49:49.503464 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:49.503397    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s4mm4" podStartSLOduration=2.541270479 podStartE2EDuration="4.503379833s" totalImagesPullingTime="1.878128975s" totalInitContainerRuntime="83.980379ms" isStatefulPod=true podCreationTimestamp="2026-11-04 05:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:49.502603504 +0000 UTC m=+37.433800899" watchObservedRunningTime="2026-11-04 05:49:49.503379833 +0000 UTC m=+37.434577231"
Nov 04 05:49:49.551546 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:49.551515    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:49.747543 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:49.747462    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:49.934836 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:49.934800    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:50.080086 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:50.079947    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:51.325733 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:51.325648    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:51.388289 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:51.388260    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8" event={"ID":"6be6ce23-8666-4c97-b82b-10b27c56a9b6","Type":"ContainerStarted","Data":"3d28ee45a556399cf818b5b1bd05721497e30eb367e09c72122539e905c7cbd8"}
Nov 04 05:49:51.388395 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:51.388349    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8" event={"ID":"6be6ce23-8666-4c97-b82b-10b27c56a9b6","Type":"ContainerStarted","Data":"1b70748762120e1b5a25fba984cc273174d32cd5d1d48755d17e93c465afe738"}
Nov 04 05:49:51.388395 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:51.388393    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8" event={"ID":"6be6ce23-8666-4c97-b82b-10b27c56a9b6","Type":"ContainerStarted","Data":"c091219708198dee8f241d0fd67598a76d6890e012e66ba593d9baa1f1e3ce6c"}
Nov 04 05:49:51.522285 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:51.522235    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:52.394185 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:52.394156    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8" event={"ID":"6be6ce23-8666-4c97-b82b-10b27c56a9b6","Type":"ContainerStarted","Data":"7932729fe9cfce73535827aca4881b1512bb4668333e6701dd79ce8f27147f16"}
Nov 04 05:49:52.440283 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:52.440255    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:52.637361 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:52.637334    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:52.840526 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:52.840495    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:52.984506 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:52.984454    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:53.403820 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:53.403788    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8" event={"ID":"6be6ce23-8666-4c97-b82b-10b27c56a9b6","Type":"ContainerStarted","Data":"a3e9674961d4056059fe15c0bd151269de8f1e9949c50b24c1d8d94feb51d048"}
Nov 04 05:49:53.404176 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:53.403907    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:49:53.404176 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:53.403936    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8" event={"ID":"6be6ce23-8666-4c97-b82b-10b27c56a9b6","Type":"ContainerStarted","Data":"0ff82787176640d027c4598bd20eb2c6e8548bd6f550f0a5a6701974563658d1"}
Nov 04 05:49:53.685424 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:53.685338    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8" podStartSLOduration=3.339110704 podStartE2EDuration="6.685325869s" totalImagesPullingTime="3.346215165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:53.632920428 +0000 UTC m=+41.564117831" watchObservedRunningTime="2026-11-04 05:49:53.685325869 +0000 UTC m=+41.616523265"
Nov 04 05:49:54.633383 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:54.633352    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:56.339879 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:56.339848    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57c9c46db9-lspgn"
Nov 04 05:49:56.663803 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:56.663719    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:56.812039 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:56.812004    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:57.421095 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:57.421059    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:57.565378 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:57.565349    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:49:59.412992 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:49:59.412965    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f88b7fb75-c5sq8"
Nov 04 05:50:00.197656 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:00.197613    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:00.346621 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:00.346559    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:01.533121 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.533088    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-f565f444b-swv9w"]
Nov 04 05:50:01.537513 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.537495    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.593074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.593055    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 04 05:50:01.625292 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.625268    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-service-ca\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.625384 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.625296    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-oauth-serving-cert\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.625384 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.625335    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-oauth-config\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.625453 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.625434    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-tmp\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.625535 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.625523    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b44dr\" (UniqueName: \"kubernetes.io/projected/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-kube-api-access-b44dr\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.625577 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.625545    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-serving-cert\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.625577 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.625572    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-config\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.645331 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.645308    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 04 05:50:01.645428 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.645366    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 04 05:50:01.645471 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.645429    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 04 05:50:01.645579 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.645564    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 04 05:50:01.645622 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.645578    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5v8p6\""
Nov 04 05:50:01.645654 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.645648    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 04 05:50:01.646266 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.646246    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f565f444b-swv9w"]
Nov 04 05:50:01.697997 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.697974    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 04 05:50:01.726205 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.726180    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-config\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.726296 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.726214    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-service-ca\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.726296 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.726230    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-oauth-serving-cert\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.726296 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.726256    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-oauth-config\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.726296 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.726280    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-tmp\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.726465 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.726305    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b44dr\" (UniqueName: \"kubernetes.io/projected/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-kube-api-access-b44dr\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.726465 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.726325    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-serving-cert\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.726800 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.726780    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-tmp\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.727028 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.727009    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-config\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.727102 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.727009    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-service-ca\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.727264 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.727243    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-oauth-serving-cert\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.728667 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.728639    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-oauth-config\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.728807 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.728791    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-serving-cert\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.785958 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.785902    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:01.792103 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.792082    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b44dr\" (UniqueName: \"kubernetes.io/projected/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-kube-api-access-b44dr\") pod \"console-f565f444b-swv9w\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") " pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.848491 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.848470    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:01.934237 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:01.934207    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:02.178036 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:02.177998    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:02.236342 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:02.236322    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f565f444b-swv9w"]
Nov 04 05:50:02.238552 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:50:02.238529    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3c8572_fe6e_40b0_a359_e1309c9d6bec.slice/crio-34f7853224d39cd5a937030e181dbdf8f731edcb05b223a481496e55cc37bedd WatchSource:0}: Error finding container 34f7853224d39cd5a937030e181dbdf8f731edcb05b223a481496e55cc37bedd: Status 404 returned error can't find the container with id 34f7853224d39cd5a937030e181dbdf8f731edcb05b223a481496e55cc37bedd
Nov 04 05:50:02.355717 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:02.355688    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:02.434143 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:02.434081    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f565f444b-swv9w" event={"ID":"6c3c8572-fe6e-40b0-a359-e1309c9d6bec","Type":"ContainerStarted","Data":"34f7853224d39cd5a937030e181dbdf8f731edcb05b223a481496e55cc37bedd"}
Nov 04 05:50:05.448833 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:05.448796    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f565f444b-swv9w" event={"ID":"6c3c8572-fe6e-40b0-a359-e1309c9d6bec","Type":"ContainerStarted","Data":"63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764"}
Nov 04 05:50:05.593976 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:05.593929    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-f565f444b-swv9w" podStartSLOduration=1.477516084 podStartE2EDuration="4.593915474s" totalImagesPullingTime="3.11639939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:50:05.593324495 +0000 UTC m=+53.524521891" watchObservedRunningTime="2026-11-04 05:50:05.593915474 +0000 UTC m=+53.525112888"
Nov 04 05:50:06.329646 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:06.329557    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:06.478797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:06.478757    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:07.469105 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:07.469072    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:07.609236 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:07.609203    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:08.186351 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:08.186316    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:08.330199 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:08.330169    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:11.849013 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:11.848981    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:11.849013 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:11.849023    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:11.853632 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:11.853611    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:12.406010 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.405982    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-cb7cc6759-cr68d"]
Nov 04 05:50:12.410036 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.410021    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.473001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.472960    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:12.473746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.473717    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:12.501594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.501573    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-oauth-config\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.501680 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.501613    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-trusted-ca-bundle\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.501680 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.501633    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-service-ca\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.501680 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.501652    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7ll\" (UniqueName: \"kubernetes.io/projected/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-kube-api-access-xr7ll\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.501835 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.501759    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-config\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.501835 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.501826    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-oauth-serving-cert\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.501975 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.501859    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-serving-cert\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.501975 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.501912    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-tmp\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603101 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603071    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7ll\" (UniqueName: \"kubernetes.io/projected/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-kube-api-access-xr7ll\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603220 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603107    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-config\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603282 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603222    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-oauth-serving-cert\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603282 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603261    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-serving-cert\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603282 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603281    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-tmp\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603516 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603452    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-oauth-config\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603573 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603543    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-trusted-ca-bundle\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603784 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603758    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-tmp\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603851 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603760    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-service-ca\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.603930 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603880    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-config\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.604005 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.603982    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-oauth-serving-cert\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.604303 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.604279    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-service-ca\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.605969 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.605944    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-oauth-config\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.606042 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.605974    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-serving-cert\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.622328 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.622308    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 04 05:50:12.623210 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.623190    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb7cc6759-cr68d"]
Nov 04 05:50:12.625072 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.625054    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-trusted-ca-bundle\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.665924 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.665869    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7ll\" (UniqueName: \"kubernetes.io/projected/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-kube-api-access-xr7ll\") pod \"console-cb7cc6759-cr68d\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") " pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:12.672588 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.672564    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:12.720073 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:12.720053    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:13.097126 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:13.097101    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb7cc6759-cr68d"]
Nov 04 05:50:13.100215 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:50:13.100190    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0bc11b_aff3_4a0d_9d6f_a1505e8f336e.slice/crio-ba075f766dd3943661a25a278bb01acd50bd863c7cb883763c16c6d2fce7bedc WatchSource:0}: Error finding container ba075f766dd3943661a25a278bb01acd50bd863c7cb883763c16c6d2fce7bedc: Status 404 returned error can't find the container with id ba075f766dd3943661a25a278bb01acd50bd863c7cb883763c16c6d2fce7bedc
Nov 04 05:50:13.326080 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:50:13.326045    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:50:13.474725 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:13.474651    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb7cc6759-cr68d" event={"ID":"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e","Type":"ContainerStarted","Data":"598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48"}
Nov 04 05:50:13.474725 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:13.474701    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb7cc6759-cr68d" event={"ID":"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e","Type":"ContainerStarted","Data":"ba075f766dd3943661a25a278bb01acd50bd863c7cb883763c16c6d2fce7bedc"}
Nov 04 05:50:13.597419 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:13.597377    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-cb7cc6759-cr68d" podStartSLOduration=1.597366183 podStartE2EDuration="1.597366183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:50:13.596937006 +0000 UTC m=+61.528134408" watchObservedRunningTime="2026-11-04 05:50:13.597366183 +0000 UTC m=+61.528563579"
Nov 04 05:50:14.874821 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:14.874791    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:15.021928 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:15.021875    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:19.674404 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:19.674367    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:19.815458 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:19.815431    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:21.341779 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:21.341744    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:21.486474 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:21.486439    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:22.721093 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:22.721067    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:22.721447 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:22.721335    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:22.726431 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:22.726404    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:23.510345 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:23.510318    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:50:23.685582 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:23.685556    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f565f444b-swv9w"]
Nov 04 05:50:31.567940 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:31.567903    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:31.713007 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:31.712981    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:39.042948 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.042911    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-smqxt-th6hc"]
Nov 04 05:50:39.043475 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.043090    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-smqxt-th6hc" podUID="6ee2686a-510f-46c5-a192-f39508e25e48" containerName="insights-gathering" containerID="cri-o://5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a" gracePeriod=30
Nov 04 05:50:39.289779 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.289752    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:50:39.386748 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.386726    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path\") pod \"6ee2686a-510f-46c5-a192-f39508e25e48\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") "
Nov 04 05:50:39.386870 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.386783    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle\") pod \"6ee2686a-510f-46c5-a192-f39508e25e48\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") "
Nov 04 05:50:39.386870 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.386849    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle\") pod \"6ee2686a-510f-46c5-a192-f39508e25e48\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") "
Nov 04 05:50:39.387056 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.387034    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq\" (UniqueName: \"kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq\") pod \"6ee2686a-510f-46c5-a192-f39508e25e48\" (UID: \"6ee2686a-510f-46c5-a192-f39508e25e48\") "
Nov 04 05:50:39.387125 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.387031    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path" pod "6ee2686a-510f-46c5-a192-f39508e25e48" (UID: "6ee2686a-510f-46c5-a192-f39508e25e48"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:50:39.387180 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.387145    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle" pod "6ee2686a-510f-46c5-a192-f39508e25e48" (UID: "6ee2686a-510f-46c5-a192-f39508e25e48"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:50:39.387295 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.387221    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle" pod "6ee2686a-510f-46c5-a192-f39508e25e48" (UID: "6ee2686a-510f-46c5-a192-f39508e25e48"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:50:39.387295 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.387267    4497 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6ee2686a-510f-46c5-a192-f39508e25e48-archives-path\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:39.387295 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.387287    4497 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-service-ca-bundle\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:39.387594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.387568    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:39.389287 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.389264    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq" pod "6ee2686a-510f-46c5-a192-f39508e25e48" (UID: "6ee2686a-510f-46c5-a192-f39508e25e48"). InnerVolumeSpecName "kube-api-access-jngrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:50:39.488087 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.488057    4497 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee2686a-510f-46c5-a192-f39508e25e48-trusted-ca-bundle\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:39.488214 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.488091    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jngrq\" (UniqueName: \"kubernetes.io/projected/6ee2686a-510f-46c5-a192-f39508e25e48-kube-api-access-jngrq\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:39.559669 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.559637    4497 generic.go:356] "Generic (PLEG): container finished" podID="6ee2686a-510f-46c5-a192-f39508e25e48" containerID="5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a" exitCode=2
Nov 04 05:50:39.559829 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.559675    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-smqxt-th6hc" event={"ID":"6ee2686a-510f-46c5-a192-f39508e25e48","Type":"ContainerDied","Data":"5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a"}
Nov 04 05:50:39.559829 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.559695    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-smqxt-th6hc"
Nov 04 05:50:39.559829 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.559709    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-smqxt-th6hc" event={"ID":"6ee2686a-510f-46c5-a192-f39508e25e48","Type":"ContainerDied","Data":"7bef305f8ea3701368bd54f5407ddf1ca08d21c94c37338ab4067dfc80841698"}
Nov 04 05:50:39.559829 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.559737    4497 scope.go:122] "RemoveContainer" containerID="5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a"
Nov 04 05:50:39.560829 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.560801    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:39.568087 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.568072    4497 scope.go:122] "RemoveContainer" containerID="5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a"
Nov 04 05:50:39.568336 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:50:39.568316    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a\": container with ID starting with 5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a not found: ID does not exist" containerID="5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a"
Nov 04 05:50:39.568379 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.568345    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a"} err="failed to get container status \"5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a\": rpc error: code = NotFound desc = could not find container \"5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a\": container with ID starting with 5890b4099640062885347064bbc2a80b454ded3a5dac48a5a39fb474d9dbf64a not found: ID does not exist"
Nov 04 05:50:39.729866 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.729811    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-smqxt-th6hc"]
Nov 04 05:50:39.735631 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:39.735613    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-smqxt-th6hc"]
Nov 04 05:50:40.210996 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:40.210964    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ee2686a-510f-46c5-a192-f39508e25e48" path="/var/lib/kubelet/pods/6ee2686a-510f-46c5-a192-f39508e25e48/volumes"
Nov 04 05:50:43.327187 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:50:43.327151    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:50:48.704584 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.704525    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-f565f444b-swv9w" podUID="6c3c8572-fe6e-40b0-a359-e1309c9d6bec" containerName="console" containerID="cri-o://63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764" gracePeriod=15
Nov 04 05:50:48.942870 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.942846    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:48.946957 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.946937    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-serving-cert\") pod \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") "
Nov 04 05:50:48.947002 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.946971    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-oauth-serving-cert\") pod \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") "
Nov 04 05:50:48.947039 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947006    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-config\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-config\") pod \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") "
Nov 04 05:50:48.947074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947057    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-kube-api-access-b44dr\" (UniqueName: \"kubernetes.io/projected/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-kube-api-access-b44dr\") pod \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") "
Nov 04 05:50:48.947108 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947089    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-service-ca\") pod \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") "
Nov 04 05:50:48.947176 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947152    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-oauth-config\") pod \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") "
Nov 04 05:50:48.947306 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947276    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-tmp\") pod \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\" (UID: \"6c3c8572-fe6e-40b0-a359-e1309c9d6bec\") "
Nov 04 05:50:48.947457 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947412    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-config" pod "6c3c8572-fe6e-40b0-a359-e1309c9d6bec" (UID: "6c3c8572-fe6e-40b0-a359-e1309c9d6bec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:50:48.947457 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947419    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-oauth-serving-cert" pod "6c3c8572-fe6e-40b0-a359-e1309c9d6bec" (UID: "6c3c8572-fe6e-40b0-a359-e1309c9d6bec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:50:48.947696 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947492    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-service-ca" pod "6c3c8572-fe6e-40b0-a359-e1309c9d6bec" (UID: "6c3c8572-fe6e-40b0-a359-e1309c9d6bec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:50:48.947696 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947535    4497 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-oauth-serving-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:48.947696 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947553    4497 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-config\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:48.947696 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.947614    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-tmp" pod "6c3c8572-fe6e-40b0-a359-e1309c9d6bec" (UID: "6c3c8572-fe6e-40b0-a359-e1309c9d6bec"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:50:48.949302 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.949277    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-kube-api-access-b44dr" pod "6c3c8572-fe6e-40b0-a359-e1309c9d6bec" (UID: "6c3c8572-fe6e-40b0-a359-e1309c9d6bec"). InnerVolumeSpecName "kube-api-access-b44dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:50:48.949659 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.949640    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-oauth-config" pod "6c3c8572-fe6e-40b0-a359-e1309c9d6bec" (UID: "6c3c8572-fe6e-40b0-a359-e1309c9d6bec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:50:48.949723 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:48.949660    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-serving-cert" pod "6c3c8572-fe6e-40b0-a359-e1309c9d6bec" (UID: "6c3c8572-fe6e-40b0-a359-e1309c9d6bec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:50:49.048171 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.048125    4497 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-oauth-config\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:49.048171 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.048147    4497 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-tmp\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:49.048171 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.048162    4497 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-console-serving-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:49.048171 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.048171    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b44dr\" (UniqueName: \"kubernetes.io/projected/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-kube-api-access-b44dr\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:49.048329 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.048180    4497 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3c8572-fe6e-40b0-a359-e1309c9d6bec-service-ca\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:50:49.591990 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.591960    4497 generic.go:356] "Generic (PLEG): container finished" podID="6c3c8572-fe6e-40b0-a359-e1309c9d6bec" containerID="63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764" exitCode=0
Nov 04 05:50:49.592154 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.592004    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f565f444b-swv9w"
Nov 04 05:50:49.592154 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.592014    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f565f444b-swv9w" event={"ID":"6c3c8572-fe6e-40b0-a359-e1309c9d6bec","Type":"ContainerDied","Data":"63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764"}
Nov 04 05:50:49.592154 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.592055    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f565f444b-swv9w" event={"ID":"6c3c8572-fe6e-40b0-a359-e1309c9d6bec","Type":"ContainerDied","Data":"34f7853224d39cd5a937030e181dbdf8f731edcb05b223a481496e55cc37bedd"}
Nov 04 05:50:49.592154 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.592074    4497 scope.go:122] "RemoveContainer" containerID="63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764"
Nov 04 05:50:49.600365 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.600347    4497 scope.go:122] "RemoveContainer" containerID="63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764"
Nov 04 05:50:49.600644 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:50:49.600621    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764\": container with ID starting with 63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764 not found: ID does not exist" containerID="63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764"
Nov 04 05:50:49.600708 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.600658    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764"} err="failed to get container status \"63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764\": rpc error: code = NotFound desc = could not find container \"63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764\": container with ID starting with 63a21c8b68bdc2e5497a42b328d479e8d42734f5653c139f38873fe15319b764 not found: ID does not exist"
Nov 04 05:50:49.809833 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.809796    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f565f444b-swv9w"]
Nov 04 05:50:49.862549 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.862467    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f565f444b-swv9w"]
Nov 04 05:50:49.863105 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.863082    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b95b5bdcd-st4bh"]
Nov 04 05:50:49.863369 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.863354    4497 cpu_manager.go:414] "containerMap: removing container" podUID="6ee2686a-510f-46c5-a192-f39508e25e48" containerName="insights-gathering"
Nov 04 05:50:49.863438 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.863372    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ee2686a-510f-46c5-a192-f39508e25e48" containerName="insights-gathering"
Nov 04 05:50:49.863438 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.863402    4497 cpu_manager.go:414] "containerMap: removing container" podUID="6c3c8572-fe6e-40b0-a359-e1309c9d6bec" containerName="console"
Nov 04 05:50:49.863438 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.863410    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c3c8572-fe6e-40b0-a359-e1309c9d6bec" containerName="console"
Nov 04 05:50:49.863584 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.863468    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ee2686a-510f-46c5-a192-f39508e25e48" containerName="insights-gathering"
Nov 04 05:50:49.863584 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.863482    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c3c8572-fe6e-40b0-a359-e1309c9d6bec" containerName="console"
Nov 04 05:50:49.867556 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.867534    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:49.931195 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.931168    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b95b5bdcd-st4bh"]
Nov 04 05:50:49.959970 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.959943    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-trusted-ca-bundle\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:49.960054 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.959972    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s8f6\" (UniqueName: \"kubernetes.io/projected/420b41f7-a110-44c3-9d8f-0793b0b5c046-kube-api-access-2s8f6\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:49.960054 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.959992    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-oauth-config\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:49.960054 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.960009    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-oauth-serving-cert\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:49.960173 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.960086    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-service-ca\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:49.960173 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.960147    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-config\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:49.960242 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.960179    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-serving-cert\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:49.960242 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:49.960201    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/420b41f7-a110-44c3-9d8f-0793b0b5c046-tmp\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.061414 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.061387    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-trusted-ca-bundle\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.061564 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.061421    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s8f6\" (UniqueName: \"kubernetes.io/projected/420b41f7-a110-44c3-9d8f-0793b0b5c046-kube-api-access-2s8f6\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.061564 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.061443    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-oauth-config\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.061564 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.061460    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-oauth-serving-cert\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.061564 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.061490    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-service-ca\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.061564 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.061519    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-config\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.061564 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.061548    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-serving-cert\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.061821 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.061575    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/420b41f7-a110-44c3-9d8f-0793b0b5c046-tmp\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.062058 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.062023    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/420b41f7-a110-44c3-9d8f-0793b0b5c046-tmp\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.062308 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.062267    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-oauth-serving-cert\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.062397 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.062382    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-config\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.062432 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.062396    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-trusted-ca-bundle\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.062605 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.062582    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-service-ca\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.064077 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.064054    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-oauth-config\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.064231 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.064215    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-serving-cert\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.124803 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.124747    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s8f6\" (UniqueName: \"kubernetes.io/projected/420b41f7-a110-44c3-9d8f-0793b0b5c046-kube-api-access-2s8f6\") pod \"console-6b95b5bdcd-st4bh\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") " pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.159534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.159508    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:50.177998 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.177978    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:50:50.210296 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.210261    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c3c8572-fe6e-40b0-a359-e1309c9d6bec" path="/var/lib/kubelet/pods/6c3c8572-fe6e-40b0-a359-e1309c9d6bec/volumes"
Nov 04 05:50:50.357899 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.357856    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:50.553796 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.553719    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b95b5bdcd-st4bh"]
Nov 04 05:50:50.557289 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:50:50.557259    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420b41f7_a110_44c3_9d8f_0793b0b5c046.slice/crio-65976ee4c9a43c006c7386308ed4bd8f325e200479e37eb08b4fd1e41b734706 WatchSource:0}: Error finding container 65976ee4c9a43c006c7386308ed4bd8f325e200479e37eb08b4fd1e41b734706: Status 404 returned error can't find the container with id 65976ee4c9a43c006c7386308ed4bd8f325e200479e37eb08b4fd1e41b734706
Nov 04 05:50:50.590560 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.590535    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:50.597661 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.597634    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b95b5bdcd-st4bh" event={"ID":"420b41f7-a110-44c3-9d8f-0793b0b5c046","Type":"ContainerStarted","Data":"65976ee4c9a43c006c7386308ed4bd8f325e200479e37eb08b4fd1e41b734706"}
Nov 04 05:50:50.738637 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:50.738599    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:50:51.602548 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:51.602516    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b95b5bdcd-st4bh" event={"ID":"420b41f7-a110-44c3-9d8f-0793b0b5c046","Type":"ContainerStarted","Data":"d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f"}
Nov 04 05:50:51.725514 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:50:51.725461    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6b95b5bdcd-st4bh" podStartSLOduration=2.725444609 podStartE2EDuration="2.725444609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:50:51.724925827 +0000 UTC m=+99.656123222" watchObservedRunningTime="2026-11-04 05:50:51.725444609 +0000 UTC m=+99.656642007"
Nov 04 05:51:00.179077 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:00.179042    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:51:00.179505 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:00.179328    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:51:00.183611 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:00.183588    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:51:00.634229 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:00.634206    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:51:00.786317 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:00.786275    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cb7cc6759-cr68d"]
Nov 04 05:51:02.578625 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:02.578595    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:51:13.325803 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:51:13.325765    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:51:17.492971 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:17.492929    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:51:25.804843 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:25.804764    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-cb7cc6759-cr68d" podUID="be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" containerName="console" containerID="cri-o://598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48" gracePeriod=15
Nov 04 05:51:26.045436 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.045413    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:51:26.089684 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.089664    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-oauth-config\") pod \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") "
Nov 04 05:51:26.089785 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.089698    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-oauth-serving-cert\") pod \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") "
Nov 04 05:51:26.089785 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.089722    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-tmp\") pod \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") "
Nov 04 05:51:26.089785 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.089743    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-kube-api-access-xr7ll\" (UniqueName: \"kubernetes.io/projected/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-kube-api-access-xr7ll\") pod \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") "
Nov 04 05:51:26.089978 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.089837    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-trusted-ca-bundle\") pod \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") "
Nov 04 05:51:26.089978 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.089880    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-service-ca\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-service-ca\") pod \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") "
Nov 04 05:51:26.089978 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.089948    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-config\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-config\") pod \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") "
Nov 04 05:51:26.090126 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.090002    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-serving-cert\") pod \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\" (UID: \"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e\") "
Nov 04 05:51:26.090126 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.090046    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-tmp" pod "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" (UID: "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:51:26.090274 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.090243    4497 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-tmp\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:51:26.090274 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.090250    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-trusted-ca-bundle" pod "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" (UID: "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:51:26.090274 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.090251    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-oauth-serving-cert" pod "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" (UID: "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:51:26.090492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.090330    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-service-ca" pod "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" (UID: "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:51:26.090492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.090369    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-config" pod "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" (UID: "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:51:26.091902 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.091864    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-kube-api-access-xr7ll" pod "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" (UID: "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e"). InnerVolumeSpecName "kube-api-access-xr7ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:51:26.092085 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.092065    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-serving-cert" pod "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" (UID: "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:51:26.092132 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.092089    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-oauth-config" pod "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" (UID: "be0bc11b-aff3-4a0d-9d6f-a1505e8f336e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:51:26.190538 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.190516    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr7ll\" (UniqueName: \"kubernetes.io/projected/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-kube-api-access-xr7ll\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:51:26.190538 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.190538    4497 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-trusted-ca-bundle\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:51:26.190668 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.190547    4497 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-service-ca\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:51:26.190668 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.190555    4497 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-config\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:51:26.190668 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.190564    4497 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-serving-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:51:26.190668 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.190572    4497 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-console-oauth-config\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:51:26.190668 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.190580    4497 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e-oauth-serving-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:51:26.713879 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.713851    4497 generic.go:356] "Generic (PLEG): container finished" podID="be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" containerID="598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48" exitCode=0
Nov 04 05:51:26.714053 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.713910    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb7cc6759-cr68d"
Nov 04 05:51:26.714053 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.713940    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb7cc6759-cr68d" event={"ID":"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e","Type":"ContainerDied","Data":"598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48"}
Nov 04 05:51:26.714053 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.714008    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb7cc6759-cr68d" event={"ID":"be0bc11b-aff3-4a0d-9d6f-a1505e8f336e","Type":"ContainerDied","Data":"ba075f766dd3943661a25a278bb01acd50bd863c7cb883763c16c6d2fce7bedc"}
Nov 04 05:51:26.714053 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.714036    4497 scope.go:122] "RemoveContainer" containerID="598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48"
Nov 04 05:51:26.721353 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.721334    4497 scope.go:122] "RemoveContainer" containerID="598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48"
Nov 04 05:51:26.721620 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:51:26.721603    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48\": container with ID starting with 598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48 not found: ID does not exist" containerID="598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48"
Nov 04 05:51:26.721666 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.721627    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48"} err="failed to get container status \"598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48\": rpc error: code = NotFound desc = could not find container \"598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48\": container with ID starting with 598645ac23250f53b24141cdf5fc758f451e664cd66b9aa1cf62c69c2d276e48 not found: ID does not exist"
Nov 04 05:51:26.886935 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.886904    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cb7cc6759-cr68d"]
Nov 04 05:51:26.939247 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:26.939228    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cb7cc6759-cr68d"]
Nov 04 05:51:28.209776 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:28.209748    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" path="/var/lib/kubelet/pods/be0bc11b-aff3-4a0d-9d6f-a1505e8f336e/volumes"
Nov 04 05:51:43.325094 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:51:43.325055    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:51:57.601797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:57.601762    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:51:57.748716 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:51:57.748684    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:02.912931 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:02.912881    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:03.182960 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:03.182872    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:03.327219 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:03.327191    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:05.303727 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.303696    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dd986dd89-9mjlb"]
Nov 04 05:52:05.304118 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.304071    4497 cpu_manager.go:414] "containerMap: removing container" podUID="be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" containerName="console"
Nov 04 05:52:05.304118 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.304090    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" containerName="console"
Nov 04 05:52:05.304224 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.304162    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="be0bc11b-aff3-4a0d-9d6f-a1505e8f336e" containerName="console"
Nov 04 05:52:05.307036 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.307021    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.415064 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.415037    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd986dd89-9mjlb"]
Nov 04 05:52:05.456870 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.456845    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-config\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.456987 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.456875    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6ks\" (UniqueName: \"kubernetes.io/projected/811191cf-9868-4ca2-9af6-f29e15fe07f8-kube-api-access-5t6ks\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.456987 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.456920    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-oauth-config\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.457057 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.457003    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-serving-cert\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.457057 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.457034    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-trusted-ca-bundle\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.457114 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.457058    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-oauth-serving-cert\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.457114 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.457090    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/811191cf-9868-4ca2-9af6-f29e15fe07f8-tmp\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.457173 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.457165    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-service-ca\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558107 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558053    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-service-ca\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558107 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558083    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-config\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558107 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558103    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6ks\" (UniqueName: \"kubernetes.io/projected/811191cf-9868-4ca2-9af6-f29e15fe07f8-kube-api-access-5t6ks\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558127    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-oauth-config\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558149    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-serving-cert\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558299 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558179    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-trusted-ca-bundle\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558437 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558367    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-oauth-serving-cert\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558437 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558405    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/811191cf-9868-4ca2-9af6-f29e15fe07f8-tmp\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.558710 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.558689    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-service-ca\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.559177 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.559151    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/811191cf-9868-4ca2-9af6-f29e15fe07f8-tmp\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.559346 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.559325    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-oauth-serving-cert\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.559407 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.559372    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-config\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.559487 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.559470    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811191cf-9868-4ca2-9af6-f29e15fe07f8-trusted-ca-bundle\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.560570 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.560549    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-oauth-config\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.560723 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.560706    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/811191cf-9868-4ca2-9af6-f29e15fe07f8-console-serving-cert\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.597781 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.597753    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:05.621335 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.621311    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6ks\" (UniqueName: \"kubernetes.io/projected/811191cf-9868-4ca2-9af6-f29e15fe07f8-kube-api-access-5t6ks\") pod \"console-6dd986dd89-9mjlb\" (UID: \"811191cf-9868-4ca2-9af6-f29e15fe07f8\") " pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:05.744976 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.744953    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:05.917178 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:05.917147    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:06.037201 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:06.037171    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:06.186220 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:06.186164    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:06.294206 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:06.294177    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd986dd89-9mjlb"]
Nov 04 05:52:06.297719 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:52:06.297694    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811191cf_9868_4ca2_9af6_f29e15fe07f8.slice/crio-d9a84ce69e9f3eb82a55320331d7e4bebfe544dcf2bc5803f9d01fe3e1f8b2bf WatchSource:0}: Error finding container d9a84ce69e9f3eb82a55320331d7e4bebfe544dcf2bc5803f9d01fe3e1f8b2bf: Status 404 returned error can't find the container with id d9a84ce69e9f3eb82a55320331d7e4bebfe544dcf2bc5803f9d01fe3e1f8b2bf
Nov 04 05:52:06.840345 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:06.840314    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd986dd89-9mjlb" event={"ID":"811191cf-9868-4ca2-9af6-f29e15fe07f8","Type":"ContainerStarted","Data":"3fc1ff0af2f1d806cbba567d0c0026f4df090ab53c5834fc00a08a1869b28353"}
Nov 04 05:52:06.840699 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:06.840362    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd986dd89-9mjlb" event={"ID":"811191cf-9868-4ca2-9af6-f29e15fe07f8","Type":"ContainerStarted","Data":"d9a84ce69e9f3eb82a55320331d7e4bebfe544dcf2bc5803f9d01fe3e1f8b2bf"}
Nov 04 05:52:06.964006 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:06.963961    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6dd986dd89-9mjlb" podStartSLOduration=1.9639468930000001 podStartE2EDuration="1.963946893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:52:06.963291485 +0000 UTC m=+174.894488880" watchObservedRunningTime="2026-11-04 05:52:06.963946893 +0000 UTC m=+174.895144290"
Nov 04 05:52:10.270691 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:10.270655    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:10.418751 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:10.418724    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:13.325304 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:52:13.325271    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:52:15.917396 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:15.917360    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:15.917801 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:15.917413    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:15.922217 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:15.922199    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:16.429859 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:16.429821    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:16.875076 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:16.875053    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dd986dd89-9mjlb"
Nov 04 05:52:17.050850 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:17.050821    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b95b5bdcd-st4bh"]
Nov 04 05:52:21.328529 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:21.328490    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:21.469515 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:21.469483    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:52:42.069797 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.069742    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6b95b5bdcd-st4bh" podUID="420b41f7-a110-44c3-9d8f-0793b0b5c046" containerName="console" containerID="cri-o://d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f" gracePeriod=15
Nov 04 05:52:42.303922 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.303877    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:52:42.405349 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405315    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/420b41f7-a110-44c3-9d8f-0793b0b5c046-kube-api-access-2s8f6\" (UniqueName: \"kubernetes.io/projected/420b41f7-a110-44c3-9d8f-0793b0b5c046-kube-api-access-2s8f6\") pod \"420b41f7-a110-44c3-9d8f-0793b0b5c046\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") "
Nov 04 05:52:42.405487 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405381    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-oauth-serving-cert\") pod \"420b41f7-a110-44c3-9d8f-0793b0b5c046\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") "
Nov 04 05:52:42.405487 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405450    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-service-ca\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-service-ca\") pod \"420b41f7-a110-44c3-9d8f-0793b0b5c046\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") "
Nov 04 05:52:42.405487 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405476    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/420b41f7-a110-44c3-9d8f-0793b0b5c046-tmp\" (UniqueName: \"kubernetes.io/empty-dir/420b41f7-a110-44c3-9d8f-0793b0b5c046-tmp\") pod \"420b41f7-a110-44c3-9d8f-0793b0b5c046\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") "
Nov 04 05:52:42.405643 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405522    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-oauth-config\") pod \"420b41f7-a110-44c3-9d8f-0793b0b5c046\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") "
Nov 04 05:52:42.405643 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405563    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-config\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-config\") pod \"420b41f7-a110-44c3-9d8f-0793b0b5c046\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") "
Nov 04 05:52:42.405643 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405619    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-trusted-ca-bundle\") pod \"420b41f7-a110-44c3-9d8f-0793b0b5c046\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") "
Nov 04 05:52:42.405779 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405653    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-serving-cert\") pod \"420b41f7-a110-44c3-9d8f-0793b0b5c046\" (UID: \"420b41f7-a110-44c3-9d8f-0793b0b5c046\") "
Nov 04 05:52:42.405824 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405760    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/420b41f7-a110-44c3-9d8f-0793b0b5c046-tmp" pod "420b41f7-a110-44c3-9d8f-0793b0b5c046" (UID: "420b41f7-a110-44c3-9d8f-0793b0b5c046"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:52:42.405824 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405805    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-oauth-serving-cert" pod "420b41f7-a110-44c3-9d8f-0793b0b5c046" (UID: "420b41f7-a110-44c3-9d8f-0793b0b5c046"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:52:42.405953 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405919    4497 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-oauth-serving-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:52:42.406009 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405949    4497 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/420b41f7-a110-44c3-9d8f-0793b0b5c046-tmp\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:52:42.406009 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405919    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-service-ca" pod "420b41f7-a110-44c3-9d8f-0793b0b5c046" (UID: "420b41f7-a110-44c3-9d8f-0793b0b5c046"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:52:42.406009 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.405954    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-config" pod "420b41f7-a110-44c3-9d8f-0793b0b5c046" (UID: "420b41f7-a110-44c3-9d8f-0793b0b5c046"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:52:42.406395 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.406310    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-trusted-ca-bundle" pod "420b41f7-a110-44c3-9d8f-0793b0b5c046" (UID: "420b41f7-a110-44c3-9d8f-0793b0b5c046"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:52:42.407544 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.407519    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/420b41f7-a110-44c3-9d8f-0793b0b5c046-kube-api-access-2s8f6" pod "420b41f7-a110-44c3-9d8f-0793b0b5c046" (UID: "420b41f7-a110-44c3-9d8f-0793b0b5c046"). InnerVolumeSpecName "kube-api-access-2s8f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:52:42.407749 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.407724    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-oauth-config" pod "420b41f7-a110-44c3-9d8f-0793b0b5c046" (UID: "420b41f7-a110-44c3-9d8f-0793b0b5c046"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:52:42.407834 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.407775    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-serving-cert" pod "420b41f7-a110-44c3-9d8f-0793b0b5c046" (UID: "420b41f7-a110-44c3-9d8f-0793b0b5c046"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:52:42.507074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.507045    4497 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-oauth-config\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:52:42.507074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.507071    4497 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-config\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:52:42.507074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.507080    4497 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-trusted-ca-bundle\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:52:42.507264 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.507089    4497 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420b41f7-a110-44c3-9d8f-0793b0b5c046-console-serving-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:52:42.507264 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.507098    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s8f6\" (UniqueName: \"kubernetes.io/projected/420b41f7-a110-44c3-9d8f-0793b0b5c046-kube-api-access-2s8f6\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:52:42.507264 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.507106    4497 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420b41f7-a110-44c3-9d8f-0793b0b5c046-service-ca\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:52:42.951959 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.951925    4497 generic.go:356] "Generic (PLEG): container finished" podID="420b41f7-a110-44c3-9d8f-0793b0b5c046" containerID="d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f" exitCode=0
Nov 04 05:52:42.952103 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.951970    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b95b5bdcd-st4bh"
Nov 04 05:52:42.952103 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.951975    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b95b5bdcd-st4bh" event={"ID":"420b41f7-a110-44c3-9d8f-0793b0b5c046","Type":"ContainerDied","Data":"d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f"}
Nov 04 05:52:42.952103 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.952022    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b95b5bdcd-st4bh" event={"ID":"420b41f7-a110-44c3-9d8f-0793b0b5c046","Type":"ContainerDied","Data":"65976ee4c9a43c006c7386308ed4bd8f325e200479e37eb08b4fd1e41b734706"}
Nov 04 05:52:42.952103 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.952045    4497 scope.go:122] "RemoveContainer" containerID="d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f"
Nov 04 05:52:42.960959 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.960945    4497 scope.go:122] "RemoveContainer" containerID="d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f"
Nov 04 05:52:42.961236 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:52:42.961219    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f\": container with ID starting with d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f not found: ID does not exist" containerID="d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f"
Nov 04 05:52:42.961306 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:42.961249    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f"} err="failed to get container status \"d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f\": rpc error: code = NotFound desc = could not find container \"d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f\": container with ID starting with d1bb957d2cb898589285c368f0d72fc30a1c3231141b125dab747391b83bf40f not found: ID does not exist"
Nov 04 05:52:43.122969 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:43.122936    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b95b5bdcd-st4bh"]
Nov 04 05:52:43.175330 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:43.175307    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b95b5bdcd-st4bh"]
Nov 04 05:52:43.325845 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:52:43.325771    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:52:44.210261 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:52:44.210234    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="420b41f7-a110-44c3-9d8f-0793b0b5c046" path="/var/lib/kubelet/pods/420b41f7-a110-44c3-9d8f-0793b0b5c046/volumes"
Nov 04 05:53:03.294431 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:53:03.294352    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:53:13.325063 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:53:13.325032    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:53:43.326048 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:53:43.326010    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:54:03.666083 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:03.666052    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:13.325066 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:54:13.325033    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:54:28.552308 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:28.552234    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:28.732808 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:28.732780    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:30.056056 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.056022    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"]
Nov 04 05:54:30.056484 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.056303    4497 cpu_manager.go:414] "containerMap: removing container" podUID="420b41f7-a110-44c3-9d8f-0793b0b5c046" containerName="console"
Nov 04 05:54:30.056484 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.056319    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="420b41f7-a110-44c3-9d8f-0793b0b5c046" containerName="console"
Nov 04 05:54:30.056484 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.056375    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="420b41f7-a110-44c3-9d8f-0793b0b5c046" containerName="console"
Nov 04 05:54:30.059025 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.059008    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.078861 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.078822    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:30.114683 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.114660    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 04 05:54:30.114683 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.114664    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 04 05:54:30.115674 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.115660    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 05:54:30.118282 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.118263    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 05:54:30.118346 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.118335    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 05:54:30.168820 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.168791    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"]
Nov 04 05:54:30.200377 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.200354    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.200457 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.200380    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e09c769-4424-42f2-93b4-1686debe72c6-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.200457 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.200403    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.200457 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.200419    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.200571 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.200548    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.200606 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.200580    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.200606 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.200600    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9drt\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-kube-api-access-d9drt\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.214678 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.214662    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 04 05:54:30.214678 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.214664    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-497ww\""
Nov 04 05:54:30.220511 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.220491    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:30.301114 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.301093    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9drt\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-kube-api-access-d9drt\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.301180 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.301137    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.301180 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.301153    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e09c769-4424-42f2-93b4-1686debe72c6-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.301254 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.301195    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.301254 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.301219    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.301345 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.301264    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.301345 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.301295    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.302169 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.301959    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.303593 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.303567    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e09c769-4424-42f2-93b4-1686debe72c6-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.303737 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.303720    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.303791 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.303743    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.303791 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.303764    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.365698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.365669    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9drt\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-kube-api-access-d9drt\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.365804 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.365784    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-44k77\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.369649 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.369632    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:30.630650 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.630558    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:30.807054 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.803551    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"]
Nov 04 05:54:30.810439 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:54:30.810414    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e09c769_4424_42f2_93b4_1686debe72c6.slice/crio-9168025f4bf02774d486ab45066fa51feeacd376ee1b6a44cf205796f9787e3b WatchSource:0}: Error finding container 9168025f4bf02774d486ab45066fa51feeacd376ee1b6a44cf205796f9787e3b: Status 404 returned error can't find the container with id 9168025f4bf02774d486ab45066fa51feeacd376ee1b6a44cf205796f9787e3b
Nov 04 05:54:30.812293 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.812279    4497 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:54:30.828618 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:30.828587    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:31.282021 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:31.281984    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77" event={"ID":"9e09c769-4424-42f2-93b4-1686debe72c6","Type":"ContainerStarted","Data":"9168025f4bf02774d486ab45066fa51feeacd376ee1b6a44cf205796f9787e3b"}
Nov 04 05:54:31.395187 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:31.395155    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:35.609377 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:35.609342    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 05:54:35.609695 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:35.609404    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 05:54:36.300624 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:36.300588    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77" event={"ID":"9e09c769-4424-42f2-93b4-1686debe72c6","Type":"ContainerStarted","Data":"15121ab312df21900ba211d51f98d98b89a381833e21f6201714e1efd0758641"}
Nov 04 05:54:36.300816 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:36.300795    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:36.302452 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:36.302423    4497 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-44k77 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:54:36.302575 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:36.302475    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77" podUID="9e09c769-4424-42f2-93b4-1686debe72c6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:54:36.517447 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:36.517405    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77" podStartSLOduration=1.721214619 podStartE2EDuration="6.517391577s" totalImagesPullingTime="4.796176958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:54:36.47899764 +0000 UTC m=+324.410195037" watchObservedRunningTime="2026-11-04 05:54:36.517391577 +0000 UTC m=+324.448588973"
Nov 04 05:54:36.873496 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:36.873460    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:37.068216 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:37.068179    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:37.304573 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:37.304504    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:54:37.397141 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:37.397095    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:37.571912 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:37.571818    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:37.769408 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:37.769373    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:37.921306 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:37.921269    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:41.554819 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:41.554788    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:43.327053 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:54:43.327020    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:54:55.651472 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:55.651425    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:55.852871 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:55.852841    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:58.597630 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:58.597593    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:54:58.795027 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:54:58.794997    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:04.051379 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:04.051344    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:13.325940 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:55:13.325906    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:55:14.915928 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:14.915871    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:15.065529 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:15.065488    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:22.231608 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:22.231571    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:23.442547 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:23.442514    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:24.659038 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:24.659008    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:25.653935 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:25.653902    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:25.831133 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:25.831093    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:27.045602 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.045570    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:27.309544 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.309456    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"]
Nov 04 05:55:27.312653 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.312630    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.341050 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.341024    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:27.390110 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.390086    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.390208 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.390117    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.390208 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.390145    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aee51510-9284-448b-84d4-6562b0ac8bdc-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.390314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.390291    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.390359 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.390330    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4kgd\" (UniqueName: \"kubernetes.io/projected/aee51510-9284-448b-84d4-6562b0ac8bdc-kube-api-access-d4kgd\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.390398 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.390361    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee51510-9284-448b-84d4-6562b0ac8bdc-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.453574 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.453540    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 05:55:27.453740 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.453584    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 05:55:27.454108 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.454088    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 05:55:27.454255 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.454129    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 05:55:27.454255 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.454162    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-8fcjx\""
Nov 04 05:55:27.454255 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.454230    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 05:55:27.491087 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.491060    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.491234 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.491100    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.491234 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.491151    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aee51510-9284-448b-84d4-6562b0ac8bdc-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.491234 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.491204    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.491377 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.491232    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4kgd\" (UniqueName: \"kubernetes.io/projected/aee51510-9284-448b-84d4-6562b0ac8bdc-kube-api-access-d4kgd\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.491377 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.491259    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee51510-9284-448b-84d4-6562b0ac8bdc-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.491604 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.491582    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aee51510-9284-448b-84d4-6562b0ac8bdc-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.493982 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.493957    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee51510-9284-448b-84d4-6562b0ac8bdc-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.494120 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.494085    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.494375 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.494351    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.494540 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.494518    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aee51510-9284-448b-84d4-6562b0ac8bdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.536713 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.536679    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:27.556355 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.556336    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4kgd\" (UniqueName: \"kubernetes.io/projected/aee51510-9284-448b-84d4-6562b0ac8bdc-kube-api-access-d4kgd\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-6hbtx\" (UID: \"aee51510-9284-448b-84d4-6562b0ac8bdc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.599089 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.599060    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"]
Nov 04 05:55:27.627020 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.626996    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:27.700419 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:27.700391    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:28.130628 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:28.130575    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"]
Nov 04 05:55:28.134493 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:55:28.134469    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee51510_9284_448b_84d4_6562b0ac8bdc.slice/crio-6add3f5259aec4df846b95ecd8e5909d3a7e5344d33a2b7606c9c0eaf3c3fe53 WatchSource:0}: Error finding container 6add3f5259aec4df846b95ecd8e5909d3a7e5344d33a2b7606c9c0eaf3c3fe53: Status 404 returned error can't find the container with id 6add3f5259aec4df846b95ecd8e5909d3a7e5344d33a2b7606c9c0eaf3c3fe53
Nov 04 05:55:28.461743 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:28.461665    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx" event={"ID":"aee51510-9284-448b-84d4-6562b0ac8bdc","Type":"ContainerStarted","Data":"6add3f5259aec4df846b95ecd8e5909d3a7e5344d33a2b7606c9c0eaf3c3fe53"}
Nov 04 05:55:30.676347 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:30.676300    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:30.871202 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:30.871166    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:31.450933 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:31.450862    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:32.480076 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:32.480048    4497 generic.go:356] "Generic (PLEG): container finished" podID="aee51510-9284-448b-84d4-6562b0ac8bdc" containerID="4c9a46d760fddbb43ac91a6a667313be0b5fc5a08112ef0544d410cb85c5dee7" exitCode=0
Nov 04 05:55:32.480469 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:32.480122    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx" event={"ID":"aee51510-9284-448b-84d4-6562b0ac8bdc","Type":"ContainerDied","Data":"4c9a46d760fddbb43ac91a6a667313be0b5fc5a08112ef0544d410cb85c5dee7"}
Nov 04 05:55:33.484572 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:33.484542    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx" event={"ID":"aee51510-9284-448b-84d4-6562b0ac8bdc","Type":"ContainerStarted","Data":"759103ab46b13488f117902556ecfbf7582f2e889f91c014c768241ce8a8202a"}
Nov 04 05:55:33.484978 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:33.484781    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:33.683300 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:33.683255    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx" podStartSLOduration=2.030080504 podStartE2EDuration="6.683243842s" totalImagesPullingTime="4.195043263s" totalInitContainerRuntime="458.120075ms" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:33.682003707 +0000 UTC m=+381.613201103" watchObservedRunningTime="2026-11-04 05:55:33.683243842 +0000 UTC m=+381.614441238"
Nov 04 05:55:34.161530 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:34.161470    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:34.311806 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:34.311774    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:34.836253 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:34.836218    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:36.447523 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:36.447490    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:36.925311 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:36.925284    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:40.090606 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:40.090573    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:40.345957 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:40.345839    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:40.520530 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:40.520496    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:41.840643 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:41.840608    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:42.138228 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:42.138142    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:42.561623 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:42.561544    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:43.326982 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:55:43.326943    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:55:44.490760 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:44.490730    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-6hbtx"
Nov 04 05:55:44.614047 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:44.614016    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:44.999656 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:44.999625    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:45.218025 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:45.217987    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:47.276774 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:47.276736    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:47.476625 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:47.476592    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:47.667729 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:47.667697    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:47.855767 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:47.855730    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:48.016930 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:48.016831    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:48.451359 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:48.451323    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:48.618732 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:48.618703    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:52.546584 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:52.546554    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:52.762557 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:52.762524    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:53.808038 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:53.807955    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:54.992170 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:54.992135    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:55.846998 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:55.846958    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:55.995492 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:55.995454    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:56.141854 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:56.141760    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:58.123272 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:58.123237    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:55:58.299460 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:55:58.299428    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:01.690873 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:01.690833    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:01.928663 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:01.928624    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:02.393460 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:02.393424    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:02.865834 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:02.865801    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:03.016590 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:03.016553    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:03.949255 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:03.949219    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:03.985074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:03.985038    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"]
Nov 04 05:56:04.046039 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.046014    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.052878 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.052854    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"]
Nov 04 05:56:04.149978 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.149950    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:04.160001 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.159983    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 04 05:56:04.160078 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.160004    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9tz6q\""
Nov 04 05:56:04.160078 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.160012    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 04 05:56:04.171596 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.171569    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blzls\" (UniqueName: \"kubernetes.io/projected/2684e9a5-c202-4312-ae39-375c64ceccda-kube-api-access-blzls\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.171698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.171611    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2684e9a5-c202-4312-ae39-375c64ceccda-tls-certs\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.171698 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.171638    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2684e9a5-c202-4312-ae39-375c64ceccda-tmp\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.272669 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.272580    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blzls\" (UniqueName: \"kubernetes.io/projected/2684e9a5-c202-4312-ae39-375c64ceccda-kube-api-access-blzls\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.272669 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.272630    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2684e9a5-c202-4312-ae39-375c64ceccda-tls-certs\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.272669 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.272649    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2684e9a5-c202-4312-ae39-375c64ceccda-tmp\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.274989 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.274964    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2684e9a5-c202-4312-ae39-375c64ceccda-tmp\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.275247 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.275227    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2684e9a5-c202-4312-ae39-375c64ceccda-tls-certs\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.336012 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.335974    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blzls\" (UniqueName: \"kubernetes.io/projected/2684e9a5-c202-4312-ae39-375c64ceccda-kube-api-access-blzls\") pod \"kube-auth-proxy-5c8546cb5f-crt7k\" (UID: \"2684e9a5-c202-4312-ae39-375c64ceccda\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.348944 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.348915    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:04.368763 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.368737    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"
Nov 04 05:56:04.507115 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.507080    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:04.663552 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.663513    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:04.764997 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.764971    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k"]
Nov 04 05:56:04.767542 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:56:04.767517    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2684e9a5_c202_4312_ae39_375c64ceccda.slice/crio-0f9f196b7a6a70bd29578b6d4b09bb93ff3fe24fa683de06118ee90ff318b0c1 WatchSource:0}: Error finding container 0f9f196b7a6a70bd29578b6d4b09bb93ff3fe24fa683de06118ee90ff318b0c1: Status 404 returned error can't find the container with id 0f9f196b7a6a70bd29578b6d4b09bb93ff3fe24fa683de06118ee90ff318b0c1
Nov 04 05:56:04.953907 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:04.953805    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:05.586868 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:05.586837    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k" event={"ID":"2684e9a5-c202-4312-ae39-375c64ceccda","Type":"ContainerStarted","Data":"0f9f196b7a6a70bd29578b6d4b09bb93ff3fe24fa683de06118ee90ff318b0c1"}
Nov 04 05:56:07.595771 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:07.595740    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k" event={"ID":"2684e9a5-c202-4312-ae39-375c64ceccda","Type":"ContainerStarted","Data":"c480dae0d796f2303ca2e4a4db9f471eabdb27df6689f747df1a4535fe72c0e9"}
Nov 04 05:56:07.721925 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:07.721862    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k" podStartSLOduration=2.007977587 podStartE2EDuration="4.721848727s" totalImagesPullingTime="2.71387114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:07.720840299 +0000 UTC m=+415.652037695" watchObservedRunningTime="2026-11-04 05:56:07.721848727 +0000 UTC m=+415.653046152"
Nov 04 05:56:07.724451 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:07.724427    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:07.873677 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:07.873638    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:09.324902 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:09.324849    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:09.569005 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:09.568977    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:12.187682 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:12.187653    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:13.325723 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:56:13.325689    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:56:16.551082 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:16.551043    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:16.703363 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:16.703325    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:18.902438 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:18.902404    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:19.097428 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:19.097376    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:19.264058 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:19.263979    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:19.406477 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:19.406438    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:20.664779 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:20.664741    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:20.872503 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:20.872474    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:23.750587 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:23.750554    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:23.944246 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:23.944216    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:27.314959 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:27.314918    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:27.460028 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:27.459999    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:27.620102 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:27.620071    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:28.958208 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:28.958174    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:29.064419 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.064387    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"]
Nov 04 05:56:29.067503 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.067485    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.104466 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.104443    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:29.122809 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.122787    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 04 05:56:29.122809 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.122787    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Nov 04 05:56:29.154294 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.154268    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-manager-config\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.154393 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.154307    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-metrics-certs\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.154393 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.154330    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-cert\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.154524 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.154500    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7cx4\" (UniqueName: \"kubernetes.io/projected/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-kube-api-access-b7cx4\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.175476 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.175451    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:56:29.175561 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.175480    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Nov 04 05:56:29.175639 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.175624    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Nov 04 05:56:29.175738 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.175726    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-mrm8r\""
Nov 04 05:56:29.176573 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.176553    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"]
Nov 04 05:56:29.255150 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.255089    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7cx4\" (UniqueName: \"kubernetes.io/projected/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-kube-api-access-b7cx4\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.255250 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.255172    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-manager-config\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.255250 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.255216    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-metrics-certs\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.255250 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.255237    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-cert\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.255926 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.255879    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-manager-config\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.257759 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.257743    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-cert\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.257812 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.257766    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-metrics-certs\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.322177 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.322151    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7cx4\" (UniqueName: \"kubernetes.io/projected/479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08-kube-api-access-b7cx4\") pod \"jobset-controller-manager-64fcb69c87-z2bh7\" (UID: \"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08\") " pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.353851 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.353830    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:29.378798 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.378768    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:29.502868 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.502835    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:29.651321 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.651292    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:29.754183 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:29.754157    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"]
Nov 04 05:56:29.758007 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:56:29.757984    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479bcd14_bfc4_4e3d_9784_ed5bc7f3fa08.slice/crio-ac90345ff3a4ceb4da35345c2f89fd81cabfca1c952d3c5019378b30726f0576 WatchSource:0}: Error finding container ac90345ff3a4ceb4da35345c2f89fd81cabfca1c952d3c5019378b30726f0576: Status 404 returned error can't find the container with id ac90345ff3a4ceb4da35345c2f89fd81cabfca1c952d3c5019378b30726f0576
Nov 04 05:56:30.667897 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:30.667862    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7" event={"ID":"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08","Type":"ContainerStarted","Data":"ac90345ff3a4ceb4da35345c2f89fd81cabfca1c952d3c5019378b30726f0576"}
Nov 04 05:56:33.679549 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:33.679519    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7" event={"ID":"479bcd14-bfc4-4e3d-9784-ed5bc7f3fa08","Type":"ContainerStarted","Data":"77fcaf6dd5bf2dbff0544e989a0941573f3e878a10ce1cf6d9910e1914065fb2"}
Nov 04 05:56:33.679938 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:33.679620    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:37.967379 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:37.967347    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:38.109640 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:38.109615    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:40.414344 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:40.414311    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:40.612330 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:40.612296    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:43.325230 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:56:43.325197    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:56:44.687241 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:44.687212    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7"
Nov 04 05:56:44.808457 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:44.808407    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-64fcb69c87-z2bh7" podStartSLOduration=11.962872101 podStartE2EDuration="15.808394845s" totalImagesPullingTime="3.845522744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:33.837398678 +0000 UTC m=+441.768596077" watchObservedRunningTime="2026-11-04 05:56:44.808394845 +0000 UTC m=+452.739592241"
Nov 04 05:56:44.845086 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:44.845037    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:45.044648 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:45.044577    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:45.196605 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:45.196573    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:45.652905 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:45.652853    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:53.144753 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:53.144721    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:56:53.286339 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:56:53.286311    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:01.120581 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:01.120550    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:01.266455 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:01.266425    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:04.804404 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:04.804370    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:07.427835 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:07.427802    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:07.581268 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:07.581232    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:07.727844 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:07.727769    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:07.884072 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:07.884047    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:12.368852 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:12.368812    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:12.525294 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:12.525255    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:13.326433 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:57:13.326402    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:57:15.643013 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:15.642972    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:15.890550 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:15.890509    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:39.160783 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:39.160710    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:39.309626 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:39.309575    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:39.452302 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:39.452231    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:39.597650 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:39.597611    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:39.746730 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:39.746658    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:39.891938 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:39.891902    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:40.095100 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:40.095070    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:40.246567 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:40.246537    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:41.724841 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:41.724804    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:42.040092 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:42.040016    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:42.183916 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:42.183872    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:42.732897 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:42.732847    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"]
Nov 04 05:57:42.733263 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:42.733077    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77" podUID="9e09c769-4424-42f2-93b4-1686debe72c6" containerName="discovery" containerID="cri-o://15121ab312df21900ba211d51f98d98b89a381833e21f6201714e1efd0758641" gracePeriod=30
Nov 04 05:57:42.900333 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:42.900024    4497 generic.go:356] "Generic (PLEG): container finished" podID="9e09c769-4424-42f2-93b4-1686debe72c6" containerID="15121ab312df21900ba211d51f98d98b89a381833e21f6201714e1efd0758641" exitCode=0
Nov 04 05:57:42.900333 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:42.900114    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77" event={"ID":"9e09c769-4424-42f2-93b4-1686debe72c6","Type":"ContainerDied","Data":"15121ab312df21900ba211d51f98d98b89a381833e21f6201714e1efd0758641"}
Nov 04 05:57:42.973627 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:42.973605    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:57:43.055327 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.055273    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-cacerts\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-cacerts\") pod \"9e09c769-4424-42f2-93b4-1686debe72c6\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") "
Nov 04 05:57:43.055327 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.055308    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-istio-token\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-istio-token\") pod \"9e09c769-4424-42f2-93b4-1686debe72c6\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") "
Nov 04 05:57:43.055327 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.055326    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-kube-api-access-d9drt\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-kube-api-access-d9drt\") pod \"9e09c769-4424-42f2-93b4-1686debe72c6\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") "
Nov 04 05:57:43.055516 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.055359    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e09c769-4424-42f2-93b4-1686debe72c6-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e09c769-4424-42f2-93b4-1686debe72c6-local-certs\") pod \"9e09c769-4424-42f2-93b4-1686debe72c6\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") "
Nov 04 05:57:43.055567 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.055529    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-ca-configmap\") pod \"9e09c769-4424-42f2-93b4-1686debe72c6\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") "
Nov 04 05:57:43.055623 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.055583    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-dns-cert\") pod \"9e09c769-4424-42f2-93b4-1686debe72c6\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") "
Nov 04 05:57:43.055697 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.055680    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-kubeconfig\") pod \"9e09c769-4424-42f2-93b4-1686debe72c6\" (UID: \"9e09c769-4424-42f2-93b4-1686debe72c6\") "
Nov 04 05:57:43.055932 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.055865    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-ca-configmap" pod "9e09c769-4424-42f2-93b4-1686debe72c6" (UID: "9e09c769-4424-42f2-93b4-1686debe72c6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:57:43.057847 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.057815    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-dns-cert" pod "9e09c769-4424-42f2-93b4-1686debe72c6" (UID: "9e09c769-4424-42f2-93b4-1686debe72c6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:57:43.058074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.058008    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-kube-api-access-d9drt" pod "9e09c769-4424-42f2-93b4-1686debe72c6" (UID: "9e09c769-4424-42f2-93b4-1686debe72c6"). InnerVolumeSpecName "kube-api-access-d9drt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:57:43.058074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.058015    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-kubeconfig" pod "9e09c769-4424-42f2-93b4-1686debe72c6" (UID: "9e09c769-4424-42f2-93b4-1686debe72c6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:57:43.058074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.058046    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e09c769-4424-42f2-93b4-1686debe72c6-local-certs" pod "9e09c769-4424-42f2-93b4-1686debe72c6" (UID: "9e09c769-4424-42f2-93b4-1686debe72c6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:57:43.058074 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.058064    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-istio-token" pod "9e09c769-4424-42f2-93b4-1686debe72c6" (UID: "9e09c769-4424-42f2-93b4-1686debe72c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:57:43.058302 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.058283    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-cacerts" pod "9e09c769-4424-42f2-93b4-1686debe72c6" (UID: "9e09c769-4424-42f2-93b4-1686debe72c6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:57:43.157089 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.157063    4497 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-kubeconfig\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:57:43.157089 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.157084    4497 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-cacerts\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:57:43.157089 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.157093    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:57:43.157248 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.157101    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9drt\" (UniqueName: \"kubernetes.io/projected/9e09c769-4424-42f2-93b4-1686debe72c6-kube-api-access-d9drt\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:57:43.157248 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.157110    4497 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e09c769-4424-42f2-93b4-1686debe72c6-local-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:57:43.157248 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.157119    4497 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-ca-configmap\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:57:43.157248 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.157126    4497 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e09c769-4424-42f2-93b4-1686debe72c6-istio-csr-dns-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:57:43.326241 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:57:43.326173    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:57:43.906938 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.906911    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77" event={"ID":"9e09c769-4424-42f2-93b4-1686debe72c6","Type":"ContainerDied","Data":"9168025f4bf02774d486ab45066fa51feeacd376ee1b6a44cf205796f9787e3b"}
Nov 04 05:57:43.907315 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.906942    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"
Nov 04 05:57:43.907315 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:43.906956    4497 scope.go:122] "RemoveContainer" containerID="15121ab312df21900ba211d51f98d98b89a381833e21f6201714e1efd0758641"
Nov 04 05:57:44.130065 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:44.130034    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"]
Nov 04 05:57:44.135550 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:44.135529    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77"]
Nov 04 05:57:44.211088 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:44.211028    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e09c769-4424-42f2-93b4-1686debe72c6" path="/var/lib/kubelet/pods/9e09c769-4424-42f2-93b4-1686debe72c6/volumes"
Nov 04 05:57:44.237079 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:44.237047    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:44.438769 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:44.438723    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:44.586534 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:44.586498    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:44.727506 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:44.727472    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:45.270742 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.270719    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"]
Nov 04 05:57:45.271131 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.271038    4497 cpu_manager.go:414] "containerMap: removing container" podUID="9e09c769-4424-42f2-93b4-1686debe72c6" containerName="discovery"
Nov 04 05:57:45.271131 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.271056    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e09c769-4424-42f2-93b4-1686debe72c6" containerName="discovery"
Nov 04 05:57:45.271234 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.271144    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e09c769-4424-42f2-93b4-1686debe72c6" containerName="discovery"
Nov 04 05:57:45.275293 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.275275    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.374265 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.374236    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69af2563-6548-4a19-9470-6075e952f9f9-openshift-service-ca\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.374379 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.374271    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-metrics-certs\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.374379 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.374294    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-maas-api-tls\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.374450 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.374413    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl4qn\" (UniqueName: \"kubernetes.io/projected/69af2563-6548-4a19-9470-6075e952f9f9-kube-api-access-hl4qn\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.382146 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.382133    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 05:57:45.382228 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.382209    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 05:57:45.382276 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.382171    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 05:57:45.382276 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.382233    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sw66w\""
Nov 04 05:57:45.382276 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.382243    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 04 05:57:45.383199 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.383184    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"]
Nov 04 05:57:45.474830 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.474802    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl4qn\" (UniqueName: \"kubernetes.io/projected/69af2563-6548-4a19-9470-6075e952f9f9-kube-api-access-hl4qn\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.474959 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.474838    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69af2563-6548-4a19-9470-6075e952f9f9-openshift-service-ca\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.474959 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.474854    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-metrics-certs\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.475070 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.474990    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-maas-api-tls\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.475425 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.475403    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69af2563-6548-4a19-9470-6075e952f9f9-openshift-service-ca\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.477367 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.477340    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-metrics-certs\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.477509 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.477488    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-maas-api-tls\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.539830 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.539780    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl4qn\" (UniqueName: \"kubernetes.io/projected/69af2563-6548-4a19-9470-6075e952f9f9-kube-api-access-hl4qn\") pod \"maas-api-674d648f7b-gm77b\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") " pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.586769 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.586748    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:45.961557 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:45.961526    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"]
Nov 04 05:57:45.964785 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:57:45.964761    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69af2563_6548_4a19_9470_6075e952f9f9.slice/crio-273c7b46e304b2a958298478dbcae323063feb593a3d7ba0e2f5b72ac91fef28 WatchSource:0}: Error finding container 273c7b46e304b2a958298478dbcae323063feb593a3d7ba0e2f5b72ac91fef28: Status 404 returned error can't find the container with id 273c7b46e304b2a958298478dbcae323063feb593a3d7ba0e2f5b72ac91fef28
Nov 04 05:57:46.918404 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:46.918368    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b" event={"ID":"69af2563-6548-4a19-9470-6075e952f9f9","Type":"ContainerStarted","Data":"273c7b46e304b2a958298478dbcae323063feb593a3d7ba0e2f5b72ac91fef28"}
Nov 04 05:57:47.324112 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:47.323960    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:47.520480 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:47.520437    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:47.666415 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:47.666381    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:47.813041 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:47.812957    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:47.955217 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:47.955121    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:48.100027 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:48.099982    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:48.242371 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:48.242292    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:48.444903 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:48.444851    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:48.593017 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:48.592983    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:48.739746 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:48.739670    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:48.928407 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:48.928377    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b" event={"ID":"69af2563-6548-4a19-9470-6075e952f9f9","Type":"ContainerStarted","Data":"dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22"}
Nov 04 05:57:48.928532 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:48.928454    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:49.050849 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:49.050804    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b" podStartSLOduration=1.205224524 podStartE2EDuration="4.050792393s" totalImagesPullingTime="2.845567869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:49.049901523 +0000 UTC m=+516.981098912" watchObservedRunningTime="2026-11-04 05:57:49.050792393 +0000 UTC m=+516.981989786"
Nov 04 05:57:54.937375 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:54.937347    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:57:55.451075 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.451039    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:55.672373 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.672344    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:57:55.752515 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.752461    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ljmlz"]
Nov 04 05:57:55.755697 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.755679    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz"
Nov 04 05:57:55.810222 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.810200    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 05:57:55.810371 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.810347    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 05:57:55.810434 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.810425    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8mtfn\""
Nov 04 05:57:55.817090 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.817061    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ljmlz"]
Nov 04 05:57:55.851270 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.851243    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c698\" (UniqueName: \"kubernetes.io/projected/761016a4-e283-4a4a-9d5e-6f249f593206-kube-api-access-7c698\") pod \"authorino-6f6944bcdd-ljmlz\" (UID: \"761016a4-e283-4a4a-9d5e-6f249f593206\") " pod="kuadrant-system/authorino-6f6944bcdd-ljmlz"
Nov 04 05:57:55.929086 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.929062    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"]
Nov 04 05:57:55.931999 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.931984    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:55.952548 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.952530    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c698\" (UniqueName: \"kubernetes.io/projected/761016a4-e283-4a4a-9d5e-6f249f593206-kube-api-access-7c698\") pod \"authorino-6f6944bcdd-ljmlz\" (UID: \"761016a4-e283-4a4a-9d5e-6f249f593206\") " pod="kuadrant-system/authorino-6f6944bcdd-ljmlz"
Nov 04 05:57:55.996559 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:55.996541    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"]
Nov 04 05:57:56.015603 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.015560    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c698\" (UniqueName: \"kubernetes.io/projected/761016a4-e283-4a4a-9d5e-6f249f593206-kube-api-access-7c698\") pod \"authorino-6f6944bcdd-ljmlz\" (UID: \"761016a4-e283-4a4a-9d5e-6f249f593206\") " pod="kuadrant-system/authorino-6f6944bcdd-ljmlz"
Nov 04 05:57:56.053604 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.053577    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-maas-api-tls\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.053693 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.053634    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-metrics-certs\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.053735 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.053695    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-openshift-service-ca\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.053735 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.053724    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcvl2\" (UniqueName: \"kubernetes.io/projected/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-kube-api-access-jcvl2\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.075240 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.075222    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz"
Nov 04 05:57:56.101613 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.101592    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ljmlz"]
Nov 04 05:57:56.129034 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.129010    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5ddf78bd9-27crm"]
Nov 04 05:57:56.132628 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.132360    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5ddf78bd9-27crm"
Nov 04 05:57:56.154609 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.154581    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-metrics-certs\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.154704 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.154622    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-openshift-service-ca\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.154704 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.154653    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcvl2\" (UniqueName: \"kubernetes.io/projected/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-kube-api-access-jcvl2\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.154770 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.154746    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-maas-api-tls\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.155412 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.155393    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-openshift-service-ca\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.157156 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.157130    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-metrics-certs\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.157319 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.157305    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-maas-api-tls\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.193504 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.193483    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5ddf78bd9-27crm"]
Nov 04 05:57:56.217931 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.217911    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcvl2\" (UniqueName: \"kubernetes.io/projected/093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8-kube-api-access-jcvl2\") pod \"maas-api-67c499f7d4-2t8s7\" (UID: \"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8\") " pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.243795 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.243769    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:56.255702 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.255680    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvtk\" (UniqueName: \"kubernetes.io/projected/35969e97-1d80-4634-b11b-38ed20176ce7-kube-api-access-hcvtk\") pod \"authorino-5ddf78bd9-27crm\" (UID: \"35969e97-1d80-4634-b11b-38ed20176ce7\") " pod="kuadrant-system/authorino-5ddf78bd9-27crm"
Nov 04 05:57:56.356122 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.356094    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvtk\" (UniqueName: \"kubernetes.io/projected/35969e97-1d80-4634-b11b-38ed20176ce7-kube-api-access-hcvtk\") pod \"authorino-5ddf78bd9-27crm\" (UID: \"35969e97-1d80-4634-b11b-38ed20176ce7\") " pod="kuadrant-system/authorino-5ddf78bd9-27crm"
Nov 04 05:57:56.419100 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.419070    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvtk\" (UniqueName: \"kubernetes.io/projected/35969e97-1d80-4634-b11b-38ed20176ce7-kube-api-access-hcvtk\") pod \"authorino-5ddf78bd9-27crm\" (UID: \"35969e97-1d80-4634-b11b-38ed20176ce7\") " pod="kuadrant-system/authorino-5ddf78bd9-27crm"
Nov 04 05:57:56.446232 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.446211    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5ddf78bd9-27crm"
Nov 04 05:57:56.447984 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.447964    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ljmlz"]
Nov 04 05:57:56.450866 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:57:56.450847    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod761016a4_e283_4a4a_9d5e_6f249f593206.slice/crio-764b3e8af2fd0c8b3482a1acddda21ec10d73dab10984092a28c9fec1bd4e87b WatchSource:0}: Error finding container 764b3e8af2fd0c8b3482a1acddda21ec10d73dab10984092a28c9fec1bd4e87b: Status 404 returned error can't find the container with id 764b3e8af2fd0c8b3482a1acddda21ec10d73dab10984092a28c9fec1bd4e87b
Nov 04 05:57:56.621440 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.621418    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"]
Nov 04 05:57:56.623174 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.623153    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5ddf78bd9-27crm"]
Nov 04 05:57:56.624085 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:57:56.624057    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093289d7_c9c6_4bba_9c4a_d1e5d1a96bb8.slice/crio-bbe9aa564b31ded1ac927a0ece327a2dd8fa133b798d3d1a51e6a4808b1ddd83 WatchSource:0}: Error finding container bbe9aa564b31ded1ac927a0ece327a2dd8fa133b798d3d1a51e6a4808b1ddd83: Status 404 returned error can't find the container with id bbe9aa564b31ded1ac927a0ece327a2dd8fa133b798d3d1a51e6a4808b1ddd83
Nov 04 05:57:56.647552 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.647527    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67bf8684ff-5xbbz"]
Nov 04 05:57:56.652099 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.652081    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 05:57:56.707102 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.707082    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 04 05:57:56.711999 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.711979    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67bf8684ff-5xbbz"]
Nov 04 05:57:56.759191 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.759165    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58fd962d-fec1-413f-9227-885d3b3fb033-tls-cert\") pod \"authorino-67bf8684ff-5xbbz\" (UID: \"58fd962d-fec1-413f-9227-885d3b3fb033\") " pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 05:57:56.759290 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.759206    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjhcc\" (UniqueName: \"kubernetes.io/projected/58fd962d-fec1-413f-9227-885d3b3fb033-kube-api-access-pjhcc\") pod \"authorino-67bf8684ff-5xbbz\" (UID: \"58fd962d-fec1-413f-9227-885d3b3fb033\") " pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 05:57:56.820619 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.820592    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5ddf78bd9-27crm"]
Nov 04 05:57:56.824349 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:57:56.824323    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35969e97_1d80_4634_b11b_38ed20176ce7.slice/crio-bbbba7a73020fb24a794abf4c1c6298c8e95f04357a240eb460d0f01d3c78ca0 WatchSource:0}: Error finding container bbbba7a73020fb24a794abf4c1c6298c8e95f04357a240eb460d0f01d3c78ca0: Status 404 returned error can't find the container with id bbbba7a73020fb24a794abf4c1c6298c8e95f04357a240eb460d0f01d3c78ca0
Nov 04 05:57:56.860140 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.860115    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58fd962d-fec1-413f-9227-885d3b3fb033-tls-cert\") pod \"authorino-67bf8684ff-5xbbz\" (UID: \"58fd962d-fec1-413f-9227-885d3b3fb033\") " pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 05:57:56.860249 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.860155    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjhcc\" (UniqueName: \"kubernetes.io/projected/58fd962d-fec1-413f-9227-885d3b3fb033-kube-api-access-pjhcc\") pod \"authorino-67bf8684ff-5xbbz\" (UID: \"58fd962d-fec1-413f-9227-885d3b3fb033\") " pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 05:57:56.862557 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.862537    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58fd962d-fec1-413f-9227-885d3b3fb033-tls-cert\") pod \"authorino-67bf8684ff-5xbbz\" (UID: \"58fd962d-fec1-413f-9227-885d3b3fb033\") " pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 05:57:56.923482 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.923431    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjhcc\" (UniqueName: \"kubernetes.io/projected/58fd962d-fec1-413f-9227-885d3b3fb033-kube-api-access-pjhcc\") pod \"authorino-67bf8684ff-5xbbz\" (UID: \"58fd962d-fec1-413f-9227-885d3b3fb033\") " pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 05:57:56.955408 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.955381    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5ddf78bd9-27crm" event={"ID":"35969e97-1d80-4634-b11b-38ed20176ce7","Type":"ContainerStarted","Data":"bbbba7a73020fb24a794abf4c1c6298c8e95f04357a240eb460d0f01d3c78ca0"}
Nov 04 05:57:56.956567 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.956545    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7" event={"ID":"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8","Type":"ContainerStarted","Data":"bbe9aa564b31ded1ac927a0ece327a2dd8fa133b798d3d1a51e6a4808b1ddd83"}
Nov 04 05:57:56.957558 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.957536    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz" event={"ID":"761016a4-e283-4a4a-9d5e-6f249f593206","Type":"ContainerStarted","Data":"764b3e8af2fd0c8b3482a1acddda21ec10d73dab10984092a28c9fec1bd4e87b"}
Nov 04 05:57:56.962840 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:56.962822    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 05:57:57.337085 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:57.337057    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67bf8684ff-5xbbz"]
Nov 04 05:57:57.339964 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:57:57.339933    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58fd962d_fec1_413f_9227_885d3b3fb033.slice/crio-673edfda3997d245d42cfc4059a0dc5b5655b261ec3200c2733fed575a3ee0a4 WatchSource:0}: Error finding container 673edfda3997d245d42cfc4059a0dc5b5655b261ec3200c2733fed575a3ee0a4: Status 404 returned error can't find the container with id 673edfda3997d245d42cfc4059a0dc5b5655b261ec3200c2733fed575a3ee0a4
Nov 04 05:57:57.962185 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:57.962150    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67bf8684ff-5xbbz" event={"ID":"58fd962d-fec1-413f-9227-885d3b3fb033","Type":"ContainerStarted","Data":"673edfda3997d245d42cfc4059a0dc5b5655b261ec3200c2733fed575a3ee0a4"}
Nov 04 05:57:57.963611 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:57.963588    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7" event={"ID":"093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8","Type":"ContainerStarted","Data":"52cf53432df990129b0c679400e278dbf1da9923825e29e55c5fdc5602dfd2f9"}
Nov 04 05:57:57.963808 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:57.963796    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:57:58.086237 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:57:58.086184    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7" podStartSLOduration=2.250848023 podStartE2EDuration="3.086167849s" totalImagesPullingTime="835.319826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:58.085665408 +0000 UTC m=+526.016862834" watchObservedRunningTime="2026-11-04 05:57:58.086167849 +0000 UTC m=+526.017365246"
Nov 04 05:58:00.989375 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:00.989286    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz" event={"ID":"761016a4-e283-4a4a-9d5e-6f249f593206","Type":"ContainerStarted","Data":"ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4"}
Nov 04 05:58:00.989375 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:00.989309    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz" podUID="761016a4-e283-4a4a-9d5e-6f249f593206" containerName="authorino" containerID="cri-o://ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4" gracePeriod=30
Nov 04 05:58:00.990943 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:00.990918    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67bf8684ff-5xbbz" event={"ID":"58fd962d-fec1-413f-9227-885d3b3fb033","Type":"ContainerStarted","Data":"64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216"}
Nov 04 05:58:01.108668 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:01.108584    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz" podStartSLOduration=1.829638238 podStartE2EDuration="6.108573205s" totalImagesPullingTime="4.278934967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:58:01.107647039 +0000 UTC m=+529.038844424" watchObservedRunningTime="2026-11-04 05:58:01.108573205 +0000 UTC m=+529.039770599"
Nov 04 05:58:01.211521 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:01.211498    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz"
Nov 04 05:58:01.235980 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:01.235924    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-67bf8684ff-5xbbz" podStartSLOduration=1.740119789 podStartE2EDuration="5.235904382s" totalImagesPullingTime="3.495784593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:58:01.234755514 +0000 UTC m=+529.165952917" watchObservedRunningTime="2026-11-04 05:58:01.235904382 +0000 UTC m=+529.167101783"
Nov 04 05:58:01.298240 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:01.298169    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/761016a4-e283-4a4a-9d5e-6f249f593206-kube-api-access-7c698\" (UniqueName: \"kubernetes.io/projected/761016a4-e283-4a4a-9d5e-6f249f593206-kube-api-access-7c698\") pod \"761016a4-e283-4a4a-9d5e-6f249f593206\" (UID: \"761016a4-e283-4a4a-9d5e-6f249f593206\") "
Nov 04 05:58:01.300490 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:01.300463    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761016a4-e283-4a4a-9d5e-6f249f593206-kube-api-access-7c698" pod "761016a4-e283-4a4a-9d5e-6f249f593206" (UID: "761016a4-e283-4a4a-9d5e-6f249f593206"). InnerVolumeSpecName "kube-api-access-7c698". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:58:01.399380 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:01.399354    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c698\" (UniqueName: \"kubernetes.io/projected/761016a4-e283-4a4a-9d5e-6f249f593206-kube-api-access-7c698\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:58:01.999755 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:01.999657    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5ddf78bd9-27crm" event={"ID":"35969e97-1d80-4634-b11b-38ed20176ce7","Type":"ContainerStarted","Data":"fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f"}
Nov 04 05:58:01.999755 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:01.999686    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5ddf78bd9-27crm" podUID="35969e97-1d80-4634-b11b-38ed20176ce7" containerName="authorino" containerID="cri-o://fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f" gracePeriod=30
Nov 04 05:58:02.001195 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.001137    4497 generic.go:356] "Generic (PLEG): container finished" podID="761016a4-e283-4a4a-9d5e-6f249f593206" containerID="ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4" exitCode=0
Nov 04 05:58:02.001195 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.001172    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz"
Nov 04 05:58:02.001314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.001195    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz" event={"ID":"761016a4-e283-4a4a-9d5e-6f249f593206","Type":"ContainerDied","Data":"ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4"}
Nov 04 05:58:02.001314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.001219    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-ljmlz" event={"ID":"761016a4-e283-4a4a-9d5e-6f249f593206","Type":"ContainerDied","Data":"764b3e8af2fd0c8b3482a1acddda21ec10d73dab10984092a28c9fec1bd4e87b"}
Nov 04 05:58:02.001314 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.001234    4497 scope.go:122] "RemoveContainer" containerID="ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4"
Nov 04 05:58:02.011560 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.011540    4497 scope.go:122] "RemoveContainer" containerID="ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4"
Nov 04 05:58:02.011873 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:58:02.011856    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4\": container with ID starting with ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4 not found: ID does not exist" containerID="ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4"
Nov 04 05:58:02.011992 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.011898    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4"} err="failed to get container status \"ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4\": rpc error: code = NotFound desc = could not find container \"ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4\": container with ID starting with ad911492d902bb552e2aa94cbb694d03392534463fb7aaa0f3aa46c3b2b88fd4 not found: ID does not exist"
Nov 04 05:58:02.118791 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.118750    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5ddf78bd9-27crm" podStartSLOduration=1.895028227 podStartE2EDuration="6.118738331s" totalImagesPullingTime="4.223710104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:58:02.118373689 +0000 UTC m=+530.049571086" watchObservedRunningTime="2026-11-04 05:58:02.118738331 +0000 UTC m=+530.049935727"
Nov 04 05:58:02.234854 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.234827    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ljmlz"]
Nov 04 05:58:02.242685 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.240572    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ljmlz"]
Nov 04 05:58:02.249169 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.249147    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5ddf78bd9-27crm"
Nov 04 05:58:02.406328 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.406305    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35969e97-1d80-4634-b11b-38ed20176ce7-kube-api-access-hcvtk\" (UniqueName: \"kubernetes.io/projected/35969e97-1d80-4634-b11b-38ed20176ce7-kube-api-access-hcvtk\") pod \"35969e97-1d80-4634-b11b-38ed20176ce7\" (UID: \"35969e97-1d80-4634-b11b-38ed20176ce7\") "
Nov 04 05:58:02.408433 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.408409    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35969e97-1d80-4634-b11b-38ed20176ce7-kube-api-access-hcvtk" pod "35969e97-1d80-4634-b11b-38ed20176ce7" (UID: "35969e97-1d80-4634-b11b-38ed20176ce7"). InnerVolumeSpecName "kube-api-access-hcvtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:58:02.507591 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:02.507570    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcvtk\" (UniqueName: \"kubernetes.io/projected/35969e97-1d80-4634-b11b-38ed20176ce7-kube-api-access-hcvtk\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:58:03.006764 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.006731    4497 generic.go:356] "Generic (PLEG): container finished" podID="35969e97-1d80-4634-b11b-38ed20176ce7" containerID="fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f" exitCode=0
Nov 04 05:58:03.007123 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.006773    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5ddf78bd9-27crm"
Nov 04 05:58:03.007123 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.006772    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5ddf78bd9-27crm" event={"ID":"35969e97-1d80-4634-b11b-38ed20176ce7","Type":"ContainerDied","Data":"fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f"}
Nov 04 05:58:03.007123 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.006904    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5ddf78bd9-27crm" event={"ID":"35969e97-1d80-4634-b11b-38ed20176ce7","Type":"ContainerDied","Data":"bbbba7a73020fb24a794abf4c1c6298c8e95f04357a240eb460d0f01d3c78ca0"}
Nov 04 05:58:03.007123 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.006933    4497 scope.go:122] "RemoveContainer" containerID="fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f"
Nov 04 05:58:03.015080 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.015063    4497 scope.go:122] "RemoveContainer" containerID="fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f"
Nov 04 05:58:03.015306 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:58:03.015287    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f\": container with ID starting with fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f not found: ID does not exist" containerID="fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f"
Nov 04 05:58:03.015353 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.015313    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f"} err="failed to get container status \"fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f\": rpc error: code = NotFound desc = could not find container \"fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f\": container with ID starting with fcdf2bf981ac00a23b6e7422a0b1f23aa2c2e9a265197f1261c2b4fff0018e8f not found: ID does not exist"
Nov 04 05:58:03.176215 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.176191    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5ddf78bd9-27crm"]
Nov 04 05:58:03.180066 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.180046    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5ddf78bd9-27crm"]
Nov 04 05:58:03.979671 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:03.979651    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67c499f7d4-2t8s7"
Nov 04 05:58:04.158188 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.158161    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"]
Nov 04 05:58:04.158526 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.158375    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b" podUID="69af2563-6548-4a19-9470-6075e952f9f9" containerName="maas-api" containerID="cri-o://dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22" gracePeriod=30
Nov 04 05:58:04.210370 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.210346    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35969e97-1d80-4634-b11b-38ed20176ce7" path="/var/lib/kubelet/pods/35969e97-1d80-4634-b11b-38ed20176ce7/volumes"
Nov 04 05:58:04.210656 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.210645    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="761016a4-e283-4a4a-9d5e-6f249f593206" path="/var/lib/kubelet/pods/761016a4-e283-4a4a-9d5e-6f249f593206/volumes"
Nov 04 05:58:04.394937 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.394913    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:58:04.521878 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.521249    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69af2563-6548-4a19-9470-6075e952f9f9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69af2563-6548-4a19-9470-6075e952f9f9-openshift-service-ca\") pod \"69af2563-6548-4a19-9470-6075e952f9f9\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") "
Nov 04 05:58:04.521878 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.521323    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-metrics-certs\") pod \"69af2563-6548-4a19-9470-6075e952f9f9\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") "
Nov 04 05:58:04.521878 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.521350    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-maas-api-tls\") pod \"69af2563-6548-4a19-9470-6075e952f9f9\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") "
Nov 04 05:58:04.521878 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.521412    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69af2563-6548-4a19-9470-6075e952f9f9-kube-api-access-hl4qn\" (UniqueName: \"kubernetes.io/projected/69af2563-6548-4a19-9470-6075e952f9f9-kube-api-access-hl4qn\") pod \"69af2563-6548-4a19-9470-6075e952f9f9\" (UID: \"69af2563-6548-4a19-9470-6075e952f9f9\") "
Nov 04 05:58:04.521878 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.521595    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69af2563-6548-4a19-9470-6075e952f9f9-openshift-service-ca" pod "69af2563-6548-4a19-9470-6075e952f9f9" (UID: "69af2563-6548-4a19-9470-6075e952f9f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:58:04.524085 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.524048    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69af2563-6548-4a19-9470-6075e952f9f9-kube-api-access-hl4qn" pod "69af2563-6548-4a19-9470-6075e952f9f9" (UID: "69af2563-6548-4a19-9470-6075e952f9f9"). InnerVolumeSpecName "kube-api-access-hl4qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:58:04.524192 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.524118    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-maas-api-tls" pod "69af2563-6548-4a19-9470-6075e952f9f9" (UID: "69af2563-6548-4a19-9470-6075e952f9f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:58:04.525399 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.525326    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-metrics-certs" pod "69af2563-6548-4a19-9470-6075e952f9f9" (UID: "69af2563-6548-4a19-9470-6075e952f9f9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:58:04.622851 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.622829    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl4qn\" (UniqueName: \"kubernetes.io/projected/69af2563-6548-4a19-9470-6075e952f9f9-kube-api-access-hl4qn\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:58:04.622851 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.622851    4497 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69af2563-6548-4a19-9470-6075e952f9f9-openshift-service-ca\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:58:04.622987 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.622861    4497 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-metrics-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:58:04.622987 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:04.622870    4497 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69af2563-6548-4a19-9470-6075e952f9f9-maas-api-tls\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 05:58:05.015377 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.015350    4497 generic.go:356] "Generic (PLEG): container finished" podID="69af2563-6548-4a19-9470-6075e952f9f9" containerID="dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22" exitCode=0
Nov 04 05:58:05.015487 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.015388    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b" event={"ID":"69af2563-6548-4a19-9470-6075e952f9f9","Type":"ContainerDied","Data":"dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22"}
Nov 04 05:58:05.015487 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.015397    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"
Nov 04 05:58:05.015487 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.015428    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-674d648f7b-gm77b" event={"ID":"69af2563-6548-4a19-9470-6075e952f9f9","Type":"ContainerDied","Data":"273c7b46e304b2a958298478dbcae323063feb593a3d7ba0e2f5b72ac91fef28"}
Nov 04 05:58:05.015487 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.015451    4497 scope.go:122] "RemoveContainer" containerID="dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22"
Nov 04 05:58:05.023557 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.023540    4497 scope.go:122] "RemoveContainer" containerID="dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22"
Nov 04 05:58:05.023839 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:58:05.023814    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22\": container with ID starting with dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22 not found: ID does not exist" containerID="dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22"
Nov 04 05:58:05.023949 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.023845    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22"} err="failed to get container status \"dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22\": rpc error: code = NotFound desc = could not find container \"dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22\": container with ID starting with dbe808e89664b6777b430df3d90d83d1cb279c5ccd7da307a2135534cf8e2c22 not found: ID does not exist"
Nov 04 05:58:05.177411 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.177388    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:58:05.185458 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.185435    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"]
Nov 04 05:58:05.237571 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:05.237549    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-674d648f7b-gm77b"]
Nov 04 05:58:06.210573 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:58:06.210511    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69af2563-6548-4a19-9470-6075e952f9f9" path="/var/lib/kubelet/pods/69af2563-6548-4a19-9470-6075e952f9f9/volumes"
Nov 04 05:58:13.325404 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:58:13.325369    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:58:43.325938 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:58:43.325902    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:59:05.561398 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:05.561324    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:59:13.325526 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:59:13.325488    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:59:36.397371 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:36.397324    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:59:36.550445 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:36.550395    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:59:43.326347 ip-10-0-143-195 kubenswrapper[4497]: E1104 05:59:43.326310    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 05:59:49.871545 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:49.871508    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:59:50.066578 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:50.066547    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:59:56.828540 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828507    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-4dhmf"]
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828766    4497 cpu_manager.go:414] "containerMap: removing container" podUID="69af2563-6548-4a19-9470-6075e952f9f9" containerName="maas-api"
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828777    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69af2563-6548-4a19-9470-6075e952f9f9" containerName="maas-api"
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828797    4497 cpu_manager.go:414] "containerMap: removing container" podUID="35969e97-1d80-4634-b11b-38ed20176ce7" containerName="authorino"
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828802    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35969e97-1d80-4634-b11b-38ed20176ce7" containerName="authorino"
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828820    4497 cpu_manager.go:414] "containerMap: removing container" podUID="761016a4-e283-4a4a-9d5e-6f249f593206" containerName="authorino"
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828825    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="761016a4-e283-4a4a-9d5e-6f249f593206" containerName="authorino"
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828867    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="761016a4-e283-4a4a-9d5e-6f249f593206" containerName="authorino"
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828874    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="69af2563-6548-4a19-9470-6075e952f9f9" containerName="maas-api"
Nov 04 05:59:56.828956 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.828899    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="35969e97-1d80-4634-b11b-38ed20176ce7" containerName="authorino"
Nov 04 05:59:56.831609 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.831594    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:56.886437 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.886410    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 04 05:59:56.918806 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.918774    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbm2w\" (UniqueName: \"kubernetes.io/projected/e875963a-1a5a-43d6-8d42-fc6fac17faba-kube-api-access-zbm2w\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:56.918806 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.918806    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:56.918998 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.918829    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:56.918998 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.918940    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:56.918998 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.918976    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-home\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:56.919108 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.918999    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e875963a-1a5a-43d6-8d42-fc6fac17faba-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:56.938636 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.938617    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 04 05:59:56.938699 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.938643    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6xl4t\""
Nov 04 05:59:56.938699 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.938643    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Nov 04 05:59:56.939740 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.939724    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-4dhmf"]
Nov 04 05:59:56.979231 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:56.979200    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 05:59:57.019594 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.019561    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.019666 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.019614    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-home\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.019666 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.019644    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e875963a-1a5a-43d6-8d42-fc6fac17faba-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.019738 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.019670    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbm2w\" (UniqueName: \"kubernetes.io/projected/e875963a-1a5a-43d6-8d42-fc6fac17faba-kube-api-access-zbm2w\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.019738 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.019685    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.019738 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.019711    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.020011 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.019993    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.020094 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.020076    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-home\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.020151 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.020119    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.021938 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.021918    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e875963a-1a5a-43d6-8d42-fc6fac17faba-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.022165 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.022150    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e875963a-1a5a-43d6-8d42-fc6fac17faba-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.082922 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.082851    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbm2w\" (UniqueName: \"kubernetes.io/projected/e875963a-1a5a-43d6-8d42-fc6fac17faba-kube-api-access-zbm2w\") pod \"echo-simulator-kserve-64b6f8f96c-4dhmf\" (UID: \"e875963a-1a5a-43d6-8d42-fc6fac17faba\") " pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.143112 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.143090    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 05:59:57.518006 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.517975    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-4dhmf"]
Nov 04 05:59:57.520910 ip-10-0-143-195 kubenswrapper[4497]: W1104 05:59:57.520864    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode875963a_1a5a_43d6_8d42_fc6fac17faba.slice/crio-30e952ba33e3d1b3e73d99f332057441430cdf3f6a925b9d89fd8d8f6ee55950 WatchSource:0}: Error finding container 30e952ba33e3d1b3e73d99f332057441430cdf3f6a925b9d89fd8d8f6ee55950: Status 404 returned error can't find the container with id 30e952ba33e3d1b3e73d99f332057441430cdf3f6a925b9d89fd8d8f6ee55950
Nov 04 05:59:57.522221 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:57.522205    4497 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:59:58.392671 ip-10-0-143-195 kubenswrapper[4497]: I1104 05:59:58.392640    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf" event={"ID":"e875963a-1a5a-43d6-8d42-fc6fac17faba","Type":"ContainerStarted","Data":"30e952ba33e3d1b3e73d99f332057441430cdf3f6a925b9d89fd8d8f6ee55950"}
Nov 04 06:00:00.401420 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:00.401392    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf" event={"ID":"e875963a-1a5a-43d6-8d42-fc6fac17faba","Type":"ContainerStarted","Data":"d7857607d4e6da98fb5621a32ed9deea642cfc0543b3d9ca2a35bc73b11b6b66"}
Nov 04 06:00:00.524629 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:00.524577    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf" podStartSLOduration=2.050616764 podStartE2EDuration="4.524562448s" totalImagesPullingTime="2.473945684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:00.523720176 +0000 UTC m=+648.454917567" watchObservedRunningTime="2026-11-04 06:00:00.524562448 +0000 UTC m=+648.455759844"
Nov 04 06:00:01.143903 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.143848    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 06:00:01.555668 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.555600    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"]
Nov 04 06:00:01.558814 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.558796    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.622286 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.622254    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"]
Nov 04 06:00:01.649989 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.649878    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:01.653907 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.653871    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.654018 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.653972    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmrn5\" (UniqueName: \"kubernetes.io/projected/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-kube-api-access-lmrn5\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.654066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.654026    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.654066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.654052    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.654140 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.654116    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.654182 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.654171    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.665842 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.665821    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Nov 04 06:00:01.754982 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.754958    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.755087 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.754991    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.755087 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.755019    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.755087 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.755044    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmrn5\" (UniqueName: \"kubernetes.io/projected/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-kube-api-access-lmrn5\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.755087 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.755074    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.755292 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.755094    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.755402 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.755379    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.755477 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.755442    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.755528 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.755477    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.757168 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.757149    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.757499 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.757479    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.819877 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.819824    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmrn5\" (UniqueName: \"kubernetes.io/projected/ce58927f-8cf1-4e45-8b58-c28d9f6f7210-kube-api-access-lmrn5\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw\" (UID: \"ce58927f-8cf1-4e45-8b58-c28d9f6f7210\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:01.872990 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:01.872965    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:02.251948 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:02.251919    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"]
Nov 04 06:00:02.254786 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:00:02.254764    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce58927f_8cf1_4e45_8b58_c28d9f6f7210.slice/crio-73b05920ff8d3215edd6c44f0d6aa83b179ae83fb9502db7d240636f5224b848 WatchSource:0}: Error finding container 73b05920ff8d3215edd6c44f0d6aa83b179ae83fb9502db7d240636f5224b848: Status 404 returned error can't find the container with id 73b05920ff8d3215edd6c44f0d6aa83b179ae83fb9502db7d240636f5224b848
Nov 04 06:00:02.409129 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:02.409086    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw" event={"ID":"ce58927f-8cf1-4e45-8b58-c28d9f6f7210","Type":"ContainerStarted","Data":"73b05920ff8d3215edd6c44f0d6aa83b179ae83fb9502db7d240636f5224b848"}
Nov 04 06:00:04.865757 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.865729    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"]
Nov 04 06:00:04.870576 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.870553    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:04.971094 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.971070    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:04.976914 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.976871    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:04.977016 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.976977    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:04.977016 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.976998    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:04.977082 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.977051    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67hnr\" (UniqueName: \"kubernetes.io/projected/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-kube-api-access-67hnr\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:04.977118 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.977090    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:04.977118 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.977107    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:04.977223 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.977210    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Nov 04 06:00:04.978390 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:04.978372    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"]
Nov 04 06:00:05.077609 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.077584    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.077724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.077613    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.077724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.077646    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.077724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.077675    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.077724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.077690    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.077724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.077714    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67hnr\" (UniqueName: \"kubernetes.io/projected/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-kube-api-access-67hnr\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.078013 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.077976    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.078066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.078052    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.078108 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.078081    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.079984 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.079959    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.080400 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.080378    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.141138 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.141081    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67hnr\" (UniqueName: \"kubernetes.io/projected/3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4-kube-api-access-67hnr\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b\" (UID: \"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.182433 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.182401    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:05.564994 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.564905    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"]
Nov 04 06:00:05.568197 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:00:05.568164    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fba1c47_0cd7_4bfa_a5fa_57b5da8949c4.slice/crio-10711985b7bae2c6fb83f4059c4e04f9d056d68939f25adf316d6f8f802a027e WatchSource:0}: Error finding container 10711985b7bae2c6fb83f4059c4e04f9d056d68939f25adf316d6f8f802a027e: Status 404 returned error can't find the container with id 10711985b7bae2c6fb83f4059c4e04f9d056d68939f25adf316d6f8f802a027e
Nov 04 06:00:05.946624 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:05.946590    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:06.424853 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:06.424821    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b" event={"ID":"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4","Type":"ContainerStarted","Data":"10711985b7bae2c6fb83f4059c4e04f9d056d68939f25adf316d6f8f802a027e"}
Nov 04 06:00:07.143478 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:07.143444    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 06:00:07.157052 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:07.157028    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 06:00:07.439016 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:07.438954    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-4dhmf"
Nov 04 06:00:07.545836 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:07.545809    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:09.211486 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.211454    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"]
Nov 04 06:00:09.214553 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.214537    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.269437 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.269414    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Nov 04 06:00:09.306642 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.306618    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:09.315106 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.315080    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"]
Nov 04 06:00:09.315243 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.315222    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.315298 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.315282    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.315369 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.315355    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.315403 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.315382    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.315438 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.315411    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.315524 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.315498    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47phj\" (UniqueName: \"kubernetes.io/projected/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-kube-api-access-47phj\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416071 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416011    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416071 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416048    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416071 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416065    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416268 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416094    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416268 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416135    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47phj\" (UniqueName: \"kubernetes.io/projected/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-kube-api-access-47phj\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416268 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416176    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416473 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416453    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416533 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416513    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.416569 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.416533    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.418358 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.418339    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.418510 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.418495    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.437638 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.437614    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b" event={"ID":"3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4","Type":"ContainerStarted","Data":"bb41013ada77ddf27f4abcf1dcfe2f95c26f4d0109b06142935896a7f337e04c"}
Nov 04 06:00:09.481074 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.481048    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47phj\" (UniqueName: \"kubernetes.io/projected/ca4fcb96-5873-4ebf-9d46-d4a172b87dd6-kube-api-access-47phj\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-5jdsl\" (UID: \"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.525850 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.525809    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:09.560816 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.560770    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b" podStartSLOduration=2.038889575 podStartE2EDuration="5.560752543s" totalImagesPullingTime="3.521862968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:09.559901745 +0000 UTC m=+657.491099139" watchObservedRunningTime="2026-11-04 06:00:09.560752543 +0000 UTC m=+657.491949940"
Nov 04 06:00:09.912195 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:09.912165    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"]
Nov 04 06:00:09.915148 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:00:09.915121    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4fcb96_5873_4ebf_9d46_d4a172b87dd6.slice/crio-0133a2ad6695764133e14c8aeb9271b2c73b8f4619b320b5656645c61c29a5b9 WatchSource:0}: Error finding container 0133a2ad6695764133e14c8aeb9271b2c73b8f4619b320b5656645c61c29a5b9: Status 404 returned error can't find the container with id 0133a2ad6695764133e14c8aeb9271b2c73b8f4619b320b5656645c61c29a5b9
Nov 04 06:00:10.183288 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:10.183229    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:10.441909 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:10.441830    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl" event={"ID":"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6","Type":"ContainerStarted","Data":"0133a2ad6695764133e14c8aeb9271b2c73b8f4619b320b5656645c61c29a5b9"}
Nov 04 06:00:10.443324 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:10.443298    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw" event={"ID":"ce58927f-8cf1-4e45-8b58-c28d9f6f7210","Type":"ContainerStarted","Data":"f0b8cc952c348a21749e57eacdebcc15eb06ef52c306accee6a138ac9e2db987"}
Nov 04 06:00:10.565292 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:10.565252    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw" podStartSLOduration=1.9066595830000002 podStartE2EDuration="9.565238867s" totalImagesPullingTime="7.658579284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:10.564966207 +0000 UTC m=+658.496163607" watchObservedRunningTime="2026-11-04 06:00:10.565238867 +0000 UTC m=+658.496436262"
Nov 04 06:00:10.873344 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:10.873319    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:11.449157 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:11.449124    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl" event={"ID":"ca4fcb96-5873-4ebf-9d46-d4a172b87dd6","Type":"ContainerStarted","Data":"b046ceb1284a120e7571f8a7a73581b097e78e8bbd5790fed25194dd2ecae8c2"}
Nov 04 06:00:11.526585 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:11.526562    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:11.571154 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:11.571119    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl" podStartSLOduration=1.815319443 podStartE2EDuration="2.57110192s" totalImagesPullingTime="755.782477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:11.570969466 +0000 UTC m=+659.502166862" watchObservedRunningTime="2026-11-04 06:00:11.57110192 +0000 UTC m=+659.502299310"
Nov 04 06:00:11.874132 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:11.874110    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:11.886298 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:11.886278    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:12.463467 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:12.463443    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw"
Nov 04 06:00:13.326045 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:00:13.325996    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:00:13.899436 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.899399    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"]
Nov 04 06:00:13.903236 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.903216    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:13.958724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.958690    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdjjb\" (UniqueName: \"kubernetes.io/projected/1f87ac85-479a-4c14-a97a-197828636993-kube-api-access-hdjjb\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:13.958911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.958806    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:13.958911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.958876    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:13.959029 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.958919    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:13.959095 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.959073    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:13.959153 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.959137    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f87ac85-479a-4c14-a97a-197828636993-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:13.996934 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:13.996879    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:14.010226 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.010203    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Nov 04 06:00:14.011466 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.011443    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"]
Nov 04 06:00:14.059670 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.059644    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.059792 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.059705    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f87ac85-479a-4c14-a97a-197828636993-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.059792 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.059749    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdjjb\" (UniqueName: \"kubernetes.io/projected/1f87ac85-479a-4c14-a97a-197828636993-kube-api-access-hdjjb\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.059930 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.059803    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.059930 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.059858    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.059930 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.059915    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.060146 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.060017    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.060278 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.060237    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.060437 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.060414    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.062105 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.062083    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f87ac85-479a-4c14-a97a-197828636993-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.062204 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.062150    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f87ac85-479a-4c14-a97a-197828636993-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.123257 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.123226    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdjjb\" (UniqueName: \"kubernetes.io/projected/1f87ac85-479a-4c14-a97a-197828636993-kube-api-access-hdjjb\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w58t4\" (UID: \"1f87ac85-479a-4c14-a97a-197828636993\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.216315 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.216252    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:14.595583 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:14.595548    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"]
Nov 04 06:00:14.598542 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:00:14.598515    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f87ac85_479a_4c14_a97a_197828636993.slice/crio-c0ae0b6752e305e50f4328d4b017d02a7e829ad05606903c74a1971997906f3b WatchSource:0}: Error finding container c0ae0b6752e305e50f4328d4b017d02a7e829ad05606903c74a1971997906f3b: Status 404 returned error can't find the container with id c0ae0b6752e305e50f4328d4b017d02a7e829ad05606903c74a1971997906f3b
Nov 04 06:00:15.182879 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:15.182852    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:15.195050 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:15.195024    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:15.465972 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:15.465909    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4" event={"ID":"1f87ac85-479a-4c14-a97a-197828636993","Type":"ContainerStarted","Data":"c0ae0b6752e305e50f4328d4b017d02a7e829ad05606903c74a1971997906f3b"}
Nov 04 06:00:15.476966 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:15.476946    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b"
Nov 04 06:00:16.471502 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:16.471464    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4" event={"ID":"1f87ac85-479a-4c14-a97a-197828636993","Type":"ContainerStarted","Data":"05a4839bc96542c593af11f42a75d04974bcce19fe869719308cb037db19e4bf"}
Nov 04 06:00:16.594204 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:16.594162    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4" podStartSLOduration=2.553457625 podStartE2EDuration="3.594146412s" totalImagesPullingTime="1.040688787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:16.592969297 +0000 UTC m=+664.524166692" watchObservedRunningTime="2026-11-04 06:00:16.594146412 +0000 UTC m=+664.525343811"
Nov 04 06:00:17.217200 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:17.217169    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:18.493854 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.493820    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"]
Nov 04 06:00:18.497328 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.497305    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.591608 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.591582    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.591729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.591615    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.591729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.591670    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.591729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.591706    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5kq4\" (UniqueName: \"kubernetes.io/projected/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-kube-api-access-t5kq4\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.591832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.591774    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.591832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.591822    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.595301 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.595274    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:18.604149 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.604127    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Nov 04 06:00:18.605427 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.605409    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"]
Nov 04 06:00:18.692934 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.692911    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.693017 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.692940    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5kq4\" (UniqueName: \"kubernetes.io/projected/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-kube-api-access-t5kq4\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.693017 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.692974    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.693017 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.693000    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.693017 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.693015    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.693192 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.693039    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.693368 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.693347    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.693441 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.693368    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.693441 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.693415    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.695145 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.695123    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.695383 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.695369    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.756756 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.756708    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5kq4\" (UniqueName: \"kubernetes.io/projected/0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0-kube-api-access-t5kq4\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8kgn6\" (UID: \"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:18.808809 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:18.808789    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:19.184328 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:19.184297    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"]
Nov 04 06:00:19.187483 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:00:19.187453    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f34c51b_c9bd_4fce_a2c4_aeeab972d3d0.slice/crio-e641a88a422e8924033618a135decb48036c767b99c444b4a1c96fdea82f37a9 WatchSource:0}: Error finding container e641a88a422e8924033618a135decb48036c767b99c444b4a1c96fdea82f37a9: Status 404 returned error can't find the container with id e641a88a422e8924033618a135decb48036c767b99c444b4a1c96fdea82f37a9
Nov 04 06:00:19.485262 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:19.485208    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6" event={"ID":"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0","Type":"ContainerStarted","Data":"e641a88a422e8924033618a135decb48036c767b99c444b4a1c96fdea82f37a9"}
Nov 04 06:00:19.526523 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:19.526502    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:19.538153 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:19.538133    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:20.490340 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:20.490298    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6" event={"ID":"0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0","Type":"ContainerStarted","Data":"fa63ad7cb1b4e93822d3f00461ecc7e8c6b5700c9a6cf7d01f2088375ba9d878"}
Nov 04 06:00:20.500996 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:20.500966    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-5jdsl"
Nov 04 06:00:20.614764 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:20.614713    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6" podStartSLOduration=2.029367455 podStartE2EDuration="2.614697626s" totalImagesPullingTime="585.330171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:20.613430351 +0000 UTC m=+668.544627746" watchObservedRunningTime="2026-11-04 06:00:20.614697626 +0000 UTC m=+668.545895025"
Nov 04 06:00:20.809673 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:20.809600    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:24.216929 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:24.216833    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:24.229120 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:24.229095    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:24.308799 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:24.308763    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:24.515421 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:24.515347    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w58t4"
Nov 04 06:00:25.224975 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.224947    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"]
Nov 04 06:00:25.228106 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.228090    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.335066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.335041    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kfq2b\""
Nov 04 06:00:25.335066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.335051    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 06:00:25.336695 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.336669    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"]
Nov 04 06:00:25.346403 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346380    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.346515 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346413    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.346515 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346441    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.346591 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346553    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz787\" (UniqueName: \"kubernetes.io/projected/beed461d-3e44-4d7e-9e36-75754374a6d6-kube-api-access-xz787\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.346591 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346581    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.346682 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346602    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.346713 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346680    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.346713 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346708    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beed461d-3e44-4d7e-9e36-75754374a6d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.346783 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.346728    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.447943 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.447918    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448035 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.447969    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448035 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448000    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448035 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448029    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448150 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448071    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz787\" (UniqueName: \"kubernetes.io/projected/beed461d-3e44-4d7e-9e36-75754374a6d6-kube-api-access-xz787\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448150 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448101    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448150 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448131    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448288 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448169    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448288 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448213    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beed461d-3e44-4d7e-9e36-75754374a6d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448537 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448514    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448660 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448589    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448660 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448648    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.448921 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448833    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.449000 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.448962    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beed461d-3e44-4d7e-9e36-75754374a6d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.450319 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.450299    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.450543 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.450527    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.511326 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.511274    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beed461d-3e44-4d7e-9e36-75754374a6d6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.511557 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.511532    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz787\" (UniqueName: \"kubernetes.io/projected/beed461d-3e44-4d7e-9e36-75754374a6d6-kube-api-access-xz787\") pod \"maas-default-gateway-openshift-default-6886b96f9-l4lrf\" (UID: \"beed461d-3e44-4d7e-9e36-75754374a6d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.540001 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.539983    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:25.974622 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:25.974595    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"]
Nov 04 06:00:25.977459 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:00:25.977428    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeed461d_3e44_4d7e_9e36_75754374a6d6.slice/crio-cacbea6c894f8e1a8fac6a4e069049b0bd7b7e6e0b6a1667108e29e5aafa4600 WatchSource:0}: Error finding container cacbea6c894f8e1a8fac6a4e069049b0bd7b7e6e0b6a1667108e29e5aafa4600: Status 404 returned error can't find the container with id cacbea6c894f8e1a8fac6a4e069049b0bd7b7e6e0b6a1667108e29e5aafa4600
Nov 04 06:00:26.514471 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:26.514438    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" event={"ID":"beed461d-3e44-4d7e-9e36-75754374a6d6","Type":"ContainerStarted","Data":"cacbea6c894f8e1a8fac6a4e069049b0bd7b7e6e0b6a1667108e29e5aafa4600"}
Nov 04 06:00:28.808983 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:28.808950    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:28.820699 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:28.820672    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:29.537631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:29.537604    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8kgn6"
Nov 04 06:00:31.350775 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.350747    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"]
Nov 04 06:00:31.354186 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.354170    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.396772 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.396744    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.396927 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.396830    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/870db804-0c00-469c-bdba-4af50f4d8553-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.396927 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.396861    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.397013 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.396970    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.397064 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.397047    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl6gs\" (UniqueName: \"kubernetes.io/projected/870db804-0c00-469c-bdba-4af50f4d8553-kube-api-access-wl6gs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.397109 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.397089    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.430978 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.430959    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Nov 04 06:00:31.444012 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.443980    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:31.462382 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.462360    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"]
Nov 04 06:00:31.497901 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.497864    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.497991 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.497908    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/870db804-0c00-469c-bdba-4af50f4d8553-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.497991 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.497927    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.497991 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.497959    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.498136 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.498079    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl6gs\" (UniqueName: \"kubernetes.io/projected/870db804-0c00-469c-bdba-4af50f4d8553-kube-api-access-wl6gs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.498136 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.498124    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.498267 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.498236    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.498352 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.498334    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.498452 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.498434    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.500292 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.500269    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/870db804-0c00-469c-bdba-4af50f4d8553-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.500388 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.500372    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/870db804-0c00-469c-bdba-4af50f4d8553-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.561531 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.561504    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl6gs\" (UniqueName: \"kubernetes.io/projected/870db804-0c00-469c-bdba-4af50f4d8553-kube-api-access-wl6gs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k\" (UID: \"870db804-0c00-469c-bdba-4af50f4d8553\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:31.666667 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:31.666604    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:32.028466 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:32.028382    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:00:32.044028 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:32.043875    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"]
Nov 04 06:00:32.046433 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:00:32.046409    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870db804_0c00_469c_bdba_4af50f4d8553.slice/crio-87e7ef31324d9033c24673fb52037e3bc3a9bff355e0fec97d0097ede356b774 WatchSource:0}: Error finding container 87e7ef31324d9033c24673fb52037e3bc3a9bff355e0fec97d0097ede356b774: Status 404 returned error can't find the container with id 87e7ef31324d9033c24673fb52037e3bc3a9bff355e0fec97d0097ede356b774
Nov 04 06:00:32.538572 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:32.538539    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k" event={"ID":"870db804-0c00-469c-bdba-4af50f4d8553","Type":"ContainerStarted","Data":"87e7ef31324d9033c24673fb52037e3bc3a9bff355e0fec97d0097ede356b774"}
Nov 04 06:00:33.544309 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:33.544274    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k" event={"ID":"870db804-0c00-469c-bdba-4af50f4d8553","Type":"ContainerStarted","Data":"ecc35a544065dbf7b30c16cf26f9f535d90f30f7fbfaa981047c26ae8db1e77e"}
Nov 04 06:00:33.667508 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:33.667483    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:33.668127 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:33.668084    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k" podStartSLOduration=2.047244502 podStartE2EDuration="2.668073367s" totalImagesPullingTime="620.828865ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:33.666581864 +0000 UTC m=+681.597779260" watchObservedRunningTime="2026-11-04 06:00:33.668073367 +0000 UTC m=+681.599270763"
Nov 04 06:00:39.441297 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:39.441264    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:00:39.441596 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:39.441327    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:00:39.441596 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:39.441360    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:00:39.574138 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:39.574104    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" event={"ID":"beed461d-3e44-4d7e-9e36-75754374a6d6","Type":"ContainerStarted","Data":"24624aaccf09a6dc98440bbc44c12c79fcb2070a0cab5cc7fbcd9fbdef2eeef6"}
Nov 04 06:00:39.732939 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:39.732823    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" podStartSLOduration=1.271731603 podStartE2EDuration="14.732807913s" totalImagesPullingTime="13.46107631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:39.732562601 +0000 UTC m=+687.663759998" watchObservedRunningTime="2026-11-04 06:00:39.732807913 +0000 UTC m=+687.664005311"
Nov 04 06:00:40.540817 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:40.540784    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:40.541239 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:40.540851    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:40.542289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:40.542263    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 06:00:40.542408 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:40.542310    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" podUID="beed461d-3e44-4d7e-9e36-75754374a6d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 06:00:41.540675 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:41.540641    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 06:00:41.540843 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:41.540690    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" podUID="beed461d-3e44-4d7e-9e36-75754374a6d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 06:00:41.667164 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:41.667131    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:41.679067 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:41.679042    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:42.540286 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:42.540251    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 06:00:42.540447 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:42.540305    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" podUID="beed461d-3e44-4d7e-9e36-75754374a6d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 06:00:42.595667 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:42.595638    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k"
Nov 04 06:00:43.348208 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:00:43.348173    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:00:43.540200 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:43.540172    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 06:00:43.540381 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:43.540220    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" podUID="beed461d-3e44-4d7e-9e36-75754374a6d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 06:00:44.540791 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:44.540755    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 06:00:44.541209 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:44.540809    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" podUID="beed461d-3e44-4d7e-9e36-75754374a6d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 06:00:45.541078 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:45.541047    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 06:00:45.541456 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:45.541097    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" podUID="beed461d-3e44-4d7e-9e36-75754374a6d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 06:00:46.540577 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:46.540542    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 06:00:46.540745 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:46.540590    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf" podUID="beed461d-3e44-4d7e-9e36-75754374a6d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 06:00:47.636460 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:47.636430    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:47.637613 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:47.637589    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf"
Nov 04 06:00:55.479037 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.479008    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"]
Nov 04 06:00:55.481750 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.481734    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.594296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.594270    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"]
Nov 04 06:00:55.620704 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.620672    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.620832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.620719    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40344774-ee6a-415c-b3f5-da522edcb596-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.620832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.620743    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmg6\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-kube-api-access-7gmg6\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.620832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.620808    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.621035 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.620839    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40344774-ee6a-415c-b3f5-da522edcb596-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.621035 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.620965    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.621035 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.621030    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.621167 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.621060    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.621167 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.621085    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.721972 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.721942    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40344774-ee6a-415c-b3f5-da522edcb596-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722097 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.721979    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmg6\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-kube-api-access-7gmg6\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722097 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.721999    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722097 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722032    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40344774-ee6a-415c-b3f5-da522edcb596-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722097 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722077    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722295 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722222    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722295 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722272    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722399 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722314    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722399 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722381    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722609 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722584    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722722 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722613    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722722 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722659    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722869 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722850    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40344774-ee6a-415c-b3f5-da522edcb596-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.722953 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.722923    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.724517 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.724498    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40344774-ee6a-415c-b3f5-da522edcb596-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.724591 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.724556    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.784718 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.784669    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.784949 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.784931    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmg6\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-kube-api-access-7gmg6\") pod \"maas-default-gateway-openshift-default-6886b96f9-6v285\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:55.792716 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:55.792692    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:56.225875 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:56.225846    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"]
Nov 04 06:00:56.228638 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:00:56.228610    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40344774_ee6a_415c_b3f5_da522edcb596.slice/crio-a35f8c70f700bac804b30623af55c5ad523e562d2f94313322c309a43cc0c3ae WatchSource:0}: Error finding container a35f8c70f700bac804b30623af55c5ad523e562d2f94313322c309a43cc0c3ae: Status 404 returned error can't find the container with id a35f8c70f700bac804b30623af55c5ad523e562d2f94313322c309a43cc0c3ae
Nov 04 06:00:56.230597 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:56.230566    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:00:56.230662 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:56.230628    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:00:56.230697 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:56.230660    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:00:56.656164 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:56.656118    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" event={"ID":"40344774-ee6a-415c-b3f5-da522edcb596","Type":"ContainerStarted","Data":"3ba756c807e071949cadc52bde2d8db45b99daa64507c344e963cfaa5f79e674"}
Nov 04 06:00:56.656667 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:56.656228    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" event={"ID":"40344774-ee6a-415c-b3f5-da522edcb596","Type":"ContainerStarted","Data":"a35f8c70f700bac804b30623af55c5ad523e562d2f94313322c309a43cc0c3ae"}
Nov 04 06:00:56.789264 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:56.789196    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" podStartSLOduration=1.78917883 podStartE2EDuration="1.78917883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:56.788406017 +0000 UTC m=+704.719603433" watchObservedRunningTime="2026-11-04 06:00:56.78917883 +0000 UTC m=+704.720376227"
Nov 04 06:00:56.792769 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:56.792747    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:00:57.794990 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:57.794956    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-6v285 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Nov 04 06:00:57.795361 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:57.795012    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Nov 04 06:00:58.793133 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:58.793104    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-6v285 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Nov 04 06:00:58.793297 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:58.793151    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Nov 04 06:00:59.793836 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:59.793799    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-6v285 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Nov 04 06:00:59.794246 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:00:59.793851    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Nov 04 06:01:00.793994 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:00.793954    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-6v285 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Nov 04 06:01:00.794380 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:00.794025    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Nov 04 06:01:01.793623 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:01.793584    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-6v285 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Nov 04 06:01:01.793802 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:01.793636    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Nov 04 06:01:02.793318 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:02.793278    4497 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-6v285 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Nov 04 06:01:02.793791 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:02.793341    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Nov 04 06:01:04.042968 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.042936    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f9fbdcdcb-6rdbx"]
Nov 04 06:01:04.048827 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.048798    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx"
Nov 04 06:01:04.092355 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.092323    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b3be3cf5-4661-4e38-8460-230a3f155013-tls-cert\") pod \"authorino-6f9fbdcdcb-6rdbx\" (UID: \"b3be3cf5-4661-4e38-8460-230a3f155013\") " pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx"
Nov 04 06:01:04.092453 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.092426    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch7ch\" (UniqueName: \"kubernetes.io/projected/b3be3cf5-4661-4e38-8460-230a3f155013-kube-api-access-ch7ch\") pod \"authorino-6f9fbdcdcb-6rdbx\" (UID: \"b3be3cf5-4661-4e38-8460-230a3f155013\") " pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx"
Nov 04 06:01:04.095024 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.094990    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:04.106954 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.106928    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9fbdcdcb-6rdbx"]
Nov 04 06:01:04.193486 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.193452    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b3be3cf5-4661-4e38-8460-230a3f155013-tls-cert\") pod \"authorino-6f9fbdcdcb-6rdbx\" (UID: \"b3be3cf5-4661-4e38-8460-230a3f155013\") " pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx"
Nov 04 06:01:04.193628 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.193514    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch7ch\" (UniqueName: \"kubernetes.io/projected/b3be3cf5-4661-4e38-8460-230a3f155013-kube-api-access-ch7ch\") pod \"authorino-6f9fbdcdcb-6rdbx\" (UID: \"b3be3cf5-4661-4e38-8460-230a3f155013\") " pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx"
Nov 04 06:01:04.195941 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.195920    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b3be3cf5-4661-4e38-8460-230a3f155013-tls-cert\") pod \"authorino-6f9fbdcdcb-6rdbx\" (UID: \"b3be3cf5-4661-4e38-8460-230a3f155013\") " pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx"
Nov 04 06:01:04.256679 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.256654    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch7ch\" (UniqueName: \"kubernetes.io/projected/b3be3cf5-4661-4e38-8460-230a3f155013-kube-api-access-ch7ch\") pod \"authorino-6f9fbdcdcb-6rdbx\" (UID: \"b3be3cf5-4661-4e38-8460-230a3f155013\") " pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx"
Nov 04 06:01:04.266112 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.266084    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:04.365631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.365604    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx"
Nov 04 06:01:04.461711 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.460468    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:01:04.462193 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.462131    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:01:04.462995 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.462978    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:01:04.748677 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:04.748598    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9fbdcdcb-6rdbx"]
Nov 04 06:01:04.751731 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:01:04.751706    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3be3cf5_4661_4e38_8460_230a3f155013.slice/crio-c94d3b7db5aff05667a1dca0bdc14a39378835d1a87dd83742c01d82007bac87 WatchSource:0}: Error finding container c94d3b7db5aff05667a1dca0bdc14a39378835d1a87dd83742c01d82007bac87: Status 404 returned error can't find the container with id c94d3b7db5aff05667a1dca0bdc14a39378835d1a87dd83742c01d82007bac87
Nov 04 06:01:05.694019 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:05.693988    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx" event={"ID":"b3be3cf5-4661-4e38-8460-230a3f155013","Type":"ContainerStarted","Data":"c94d3b7db5aff05667a1dca0bdc14a39378835d1a87dd83742c01d82007bac87"}
Nov 04 06:01:06.315211 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:06.315124    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:09.710481 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:09.710444    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx" event={"ID":"b3be3cf5-4661-4e38-8460-230a3f155013","Type":"ContainerStarted","Data":"6c0c433525a0933b8ec2a6e5965a2220b90cccd29190b71b123f988c93afdcb9"}
Nov 04 06:01:09.831334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:09.831273    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f9fbdcdcb-6rdbx" podStartSLOduration=2.513459272 podStartE2EDuration="6.831252408s" totalImagesPullingTime="4.317793136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:01:09.829226137 +0000 UTC m=+717.760423536" watchObservedRunningTime="2026-11-04 06:01:09.831252408 +0000 UTC m=+717.762449807"
Nov 04 06:01:09.883706 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:09.883670    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67bf8684ff-5xbbz"]
Nov 04 06:01:09.883973 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:09.883914    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-67bf8684ff-5xbbz" podUID="58fd962d-fec1-413f-9227-885d3b3fb033" containerName="authorino" containerID="cri-o://64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216" gracePeriod=30
Nov 04 06:01:10.136804 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.136777    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 06:01:10.245421 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.245390    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58fd962d-fec1-413f-9227-885d3b3fb033-kube-api-access-pjhcc\" (UniqueName: \"kubernetes.io/projected/58fd962d-fec1-413f-9227-885d3b3fb033-kube-api-access-pjhcc\") pod \"58fd962d-fec1-413f-9227-885d3b3fb033\" (UID: \"58fd962d-fec1-413f-9227-885d3b3fb033\") "
Nov 04 06:01:10.245695 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.245452    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58fd962d-fec1-413f-9227-885d3b3fb033-tls-cert\" (UniqueName: \"kubernetes.io/secret/58fd962d-fec1-413f-9227-885d3b3fb033-tls-cert\") pod \"58fd962d-fec1-413f-9227-885d3b3fb033\" (UID: \"58fd962d-fec1-413f-9227-885d3b3fb033\") "
Nov 04 06:01:10.247649 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.247620    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58fd962d-fec1-413f-9227-885d3b3fb033-kube-api-access-pjhcc" pod "58fd962d-fec1-413f-9227-885d3b3fb033" (UID: "58fd962d-fec1-413f-9227-885d3b3fb033"). InnerVolumeSpecName "kube-api-access-pjhcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:01:10.256633 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.256592    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58fd962d-fec1-413f-9227-885d3b3fb033-tls-cert" pod "58fd962d-fec1-413f-9227-885d3b3fb033" (UID: "58fd962d-fec1-413f-9227-885d3b3fb033"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:01:10.347010 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.346971    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjhcc\" (UniqueName: \"kubernetes.io/projected/58fd962d-fec1-413f-9227-885d3b3fb033-kube-api-access-pjhcc\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:01:10.347010 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.347004    4497 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58fd962d-fec1-413f-9227-885d3b3fb033-tls-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:01:10.715785 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.715747    4497 generic.go:356] "Generic (PLEG): container finished" podID="58fd962d-fec1-413f-9227-885d3b3fb033" containerID="64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216" exitCode=0
Nov 04 06:01:10.716296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.715798    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67bf8684ff-5xbbz"
Nov 04 06:01:10.716296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.715825    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67bf8684ff-5xbbz" event={"ID":"58fd962d-fec1-413f-9227-885d3b3fb033","Type":"ContainerDied","Data":"64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216"}
Nov 04 06:01:10.716296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.715871    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67bf8684ff-5xbbz" event={"ID":"58fd962d-fec1-413f-9227-885d3b3fb033","Type":"ContainerDied","Data":"673edfda3997d245d42cfc4059a0dc5b5655b261ec3200c2733fed575a3ee0a4"}
Nov 04 06:01:10.716296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.715903    4497 scope.go:122] "RemoveContainer" containerID="64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216"
Nov 04 06:01:10.724274 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.724251    4497 scope.go:122] "RemoveContainer" containerID="64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216"
Nov 04 06:01:10.724548 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:01:10.724529    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216\": container with ID starting with 64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216 not found: ID does not exist" containerID="64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216"
Nov 04 06:01:10.724625 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.724556    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216"} err="failed to get container status \"64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216\": rpc error: code = NotFound desc = could not find container \"64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216\": container with ID starting with 64b1eb9a7d89cb9fee447469bf351fd302a2f2f8e5222afccaaa80c4afe5f216 not found: ID does not exist"
Nov 04 06:01:10.885445 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.885413    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67bf8684ff-5xbbz"]
Nov 04 06:01:10.889472 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:10.889442    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67bf8684ff-5xbbz"]
Nov 04 06:01:12.239911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:12.237103    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58fd962d-fec1-413f-9227-885d3b3fb033" path="/var/lib/kubelet/pods/58fd962d-fec1-413f-9227-885d3b3fb033/volumes"
Nov 04 06:01:13.326798 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:01:13.326761    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:01:13.422788 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:13.422755    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:13.602446 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:13.602374    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:37.623594 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:37.623559    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:38.126702 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:38.126665    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:39.758541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:39.758497    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:39.961480 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:39.961448    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:41.495622 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:41.495581    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:41.653489 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:01:41.653461    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:01:43.327635 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:01:43.327597    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:02:06.689782 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:06.689741    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:11.267802 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.267757    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:11.466270 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.466231    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:11.818671 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.818636    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"]
Nov 04 06:02:11.819132 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.819113    4497 cpu_manager.go:414] "containerMap: removing container" podUID="58fd962d-fec1-413f-9227-885d3b3fb033" containerName="authorino"
Nov 04 06:02:11.819233 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.819135    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58fd962d-fec1-413f-9227-885d3b3fb033" containerName="authorino"
Nov 04 06:02:11.819233 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.819230    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="58fd962d-fec1-413f-9227-885d3b3fb033" containerName="authorino"
Nov 04 06:02:11.822270 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.822239    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.877918 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.877869    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-856c68-openshift-default-dockercfg-fv7lh\""
Nov 04 06:02:11.916656 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.916621    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:11.934198 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.934161    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"]
Nov 04 06:02:11.950220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950166    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.950220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950216    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgxwn\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-kube-api-access-mgxwn\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.950481 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950319    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.950481 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950368    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.950481 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950433    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.950481 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950453    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.950636 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950505    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d102d6b7-9522-4824-a62b-7817609622ee-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.950636 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950588    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d102d6b7-9522-4824-a62b-7817609622ee-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:11.950730 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:11.950635    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052227 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052185    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052227 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052226    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgxwn\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-kube-api-access-mgxwn\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052505 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052250    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052505 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052315    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052505 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052398    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052505 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052427    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052505 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052451    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d102d6b7-9522-4824-a62b-7817609622ee-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052505 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052491    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d102d6b7-9522-4824-a62b-7817609622ee-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052775 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052553    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052775 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052628    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052842 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052769    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.052942 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052919    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.053014 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.052987    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.053240 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.053221    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d102d6b7-9522-4824-a62b-7817609622ee-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.054995 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.054970    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.055222 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.055200    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d102d6b7-9522-4824-a62b-7817609622ee-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.116183 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.116148    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.116343 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.116235    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgxwn\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-kube-api-access-mgxwn\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.135379 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.135340    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:12.326459 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.326420    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:12.470867 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.470760    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:12.578404 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.578371    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"]
Nov 04 06:02:12.581565 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:12.581537    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd102d6b7_9522_4824_a62b_7817609622ee.slice/crio-626d043528bad48eea4d15b3f9d89730cbbf1e46f883ef932f53cde1ebcc52b3 WatchSource:0}: Error finding container 626d043528bad48eea4d15b3f9d89730cbbf1e46f883ef932f53cde1ebcc52b3: Status 404 returned error can't find the container with id 626d043528bad48eea4d15b3f9d89730cbbf1e46f883ef932f53cde1ebcc52b3
Nov 04 06:02:12.589638 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.589592    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:12.589765 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.589688    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:12.589765 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.589728    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:12.620047 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.619906    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:12.770575 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.770488    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:12.922828 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.922779    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"]
Nov 04 06:02:12.926482 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.926458    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:12.928652 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.928617    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:12.981489 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.981454    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-32f7d6-openshift-default-dockercfg-vgfph\""
Nov 04 06:02:12.991859 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.991823    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"]
Nov 04 06:02:12.995050 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.995009    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" event={"ID":"d102d6b7-9522-4824-a62b-7817609622ee","Type":"ContainerStarted","Data":"b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb"}
Nov 04 06:02:12.995249 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:12.995093    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" event={"ID":"d102d6b7-9522-4824-a62b-7817609622ee","Type":"ContainerStarted","Data":"626d043528bad48eea4d15b3f9d89730cbbf1e46f883ef932f53cde1ebcc52b3"}
Nov 04 06:02:13.062517 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062420    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-podinfo\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.062517 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062506    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-certs\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.062704 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062536    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-data\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.062704 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062576    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-token\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.062778 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062705    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-credential-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.062778 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062738    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-envoy\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.062778 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062766    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rllm\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-kube-api-access-2rllm\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.062954 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062855    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istiod-ca-cert\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.062954 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.062915    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.077184 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.077144    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:13.136334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.136293    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:13.141649 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.141620    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:13.163775 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.163742    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-token\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.163944 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.163788    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-credential-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.163944 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.163815    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-envoy\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164126 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164072    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rllm\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-kube-api-access-2rllm\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164248 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164164    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istiod-ca-cert\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164248 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164220    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164248 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164238    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-credential-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164428 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164254    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-podinfo\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164428 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164311    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-certs\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164428 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164340    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-data\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164616 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164593    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-socket\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164712 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164682    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-certs\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.164838 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.164811    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-data\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.165174 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.165157    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istiod-ca-cert\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.166878 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.166852    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-envoy\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.167143 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.167037    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-podinfo\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.174870 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.174817    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podStartSLOduration=2.174802845 podStartE2EDuration="2.174802845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:13.173400113 +0000 UTC m=+781.104597535" watchObservedRunningTime="2026-11-04 06:02:13.174802845 +0000 UTC m=+781.106000242"
Nov 04 06:02:13.223844 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.223801    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:13.227664 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.227626    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-token\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.227811 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.227738    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rllm\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-kube-api-access-2rllm\") pod \"e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") " pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.239368 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.239339    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:13.346139 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:13.346098    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:02:13.370072 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.370040    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:13.591170 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.591131    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:13.681778 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.681726    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"]
Nov 04 06:02:13.685357 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:13.685327    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf225a8f6_5390_429f_9dbc_d2cd97e7303c.slice/crio-5a522c403ab39c4b492b480cc4283eefb25615c9269884a91b1bb3b995d32668 WatchSource:0}: Error finding container 5a522c403ab39c4b492b480cc4283eefb25615c9269884a91b1bb3b995d32668: Status 404 returned error can't find the container with id 5a522c403ab39c4b492b480cc4283eefb25615c9269884a91b1bb3b995d32668
Nov 04 06:02:13.688149 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.688113    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:13.688240 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.688188    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:13.688240 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.688217    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:13.739639 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.739603    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:13.935103 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.935011    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:13.974279 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.974234    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"]
Nov 04 06:02:13.977006 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:13.976979    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.004145 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.004066    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" event={"ID":"f225a8f6-5390-429f-9dbc-d2cd97e7303c","Type":"ContainerStarted","Data":"45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81"}
Nov 04 06:02:14.004145 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.004143    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:14.005235 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.004175    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" event={"ID":"f225a8f6-5390-429f-9dbc-d2cd97e7303c","Type":"ContainerStarted","Data":"5a522c403ab39c4b492b480cc4283eefb25615c9269884a91b1bb3b995d32668"}
Nov 04 06:02:14.011853 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.011632    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:14.031987 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.031950    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-356418-openshift-default-dockercfg-btfls\""
Nov 04 06:02:14.046074 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.046038    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"]
Nov 04 06:02:14.073935 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.073897    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdtg2\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-kube-api-access-xdtg2\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.074130 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.073949    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df4bacd-8439-4779-84c8-322435514bad-istiod-ca-cert\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.074130 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.074058    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-envoy\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.074240 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.074166    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-data\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.074240 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.074190    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df4bacd-8439-4779-84c8-322435514bad-istio-podinfo\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.074380 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.074288    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.074380 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.074331    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-istio-token\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.074380 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.074349    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-certs\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.074380 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.074371    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-credential-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.090391 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.090358    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:14.175641 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.175590    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-envoy\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.175848 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.175682    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-data\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.175848 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.175706    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df4bacd-8439-4779-84c8-322435514bad-istio-podinfo\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.176216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.176168    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-data\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.176337 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.176261    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.176337 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.176292    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-istio-token\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.176337 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.176322    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-certs\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.176671 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.176357    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-credential-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.176671 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.176515    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdtg2\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-kube-api-access-xdtg2\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.176671 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.176535    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df4bacd-8439-4779-84c8-322435514bad-istiod-ca-cert\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.176819 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.176738    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.177216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.177185    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df4bacd-8439-4779-84c8-322435514bad-istiod-ca-cert\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.177299 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.177231    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-credential-socket\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.177359 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.177323    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-certs\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.178463 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.178437    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-envoy\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.178586 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.178570    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df4bacd-8439-4779-84c8-322435514bad-istio-podinfo\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.224845 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.224743    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" podStartSLOduration=2.224726558 podStartE2EDuration="2.224726558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:14.22340292 +0000 UTC m=+782.154600318" watchObservedRunningTime="2026-11-04 06:02:14.224726558 +0000 UTC m=+782.155923956"
Nov 04 06:02:14.239627 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.239586    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:14.242845 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.242814    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-istio-token\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.243680 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.243653    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdtg2\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-kube-api-access-xdtg2\") pod \"e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") " pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.245618 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.245598    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:14.291593 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.291556    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:14.367869 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.348150    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:14.732788 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.732754    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"]
Nov 04 06:02:14.735869 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:14.735829    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df4bacd_8439_4779_84c8_322435514bad.slice/crio-448179fffe508877d3633189ae218349422113c80343afb7910bb06c6cf6de6e WatchSource:0}: Error finding container 448179fffe508877d3633189ae218349422113c80343afb7910bb06c6cf6de6e: Status 404 returned error can't find the container with id 448179fffe508877d3633189ae218349422113c80343afb7910bb06c6cf6de6e
Nov 04 06:02:14.738128 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.738094    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:14.738199 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.738161    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:14.738199 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:14.738188    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:15.009913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:15.009801    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" event={"ID":"7df4bacd-8439-4779-84c8-322435514bad","Type":"ContainerStarted","Data":"228cb78ca2728876aa6d5059694c29ba7c8ebf0fb076c8e49737cd54ac560cae"}
Nov 04 06:02:15.010092 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:15.009925    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" event={"ID":"7df4bacd-8439-4779-84c8-322435514bad","Type":"ContainerStarted","Data":"448179fffe508877d3633189ae218349422113c80343afb7910bb06c6cf6de6e"}
Nov 04 06:02:15.010381 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:15.010360    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:15.011436 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:15.011417    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:02:15.139160 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:15.139100    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" podStartSLOduration=2.139076261 podStartE2EDuration="2.139076261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:15.138979014 +0000 UTC m=+783.070176408" watchObservedRunningTime="2026-11-04 06:02:15.139076261 +0000 UTC m=+783.070273659"
Nov 04 06:02:15.292623 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:15.292530    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:15.297901 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:15.297859    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:16.014591 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:16.014556    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:16.015717 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:16.015699    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:02:16.485459 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:16.485417    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:16.671874 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:16.671836    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:16.886090 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:16.886061    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:17.527693 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:17.527651    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:17.711290 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:17.711250    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:17.856529 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:17.856496    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:18.375960 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:18.375923    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:18.553548 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:18.553501    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:18.699603 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:18.699498    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:19.008246 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:19.008158    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:19.213005 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:19.212959    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:19.363640 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:19.363603    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:20.837029 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:20.836985    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:21.044611 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:21.044576    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:21.458026 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:21.457984    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:21.613741 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:21.613705    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:21.762767 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:21.762662    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:23.301923 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:23.301858    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:23.506831 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:23.506792    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:26.843308 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:26.843265    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:27.035212 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.035171    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:27.274531 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.274429    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"]
Nov 04 06:02:27.279516 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.279484    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:27.390222 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.390185    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-f38f69\""
Nov 04 06:02:27.390491 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.390282    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-f38f69-dockercfg-hfnw4\""
Nov 04 06:02:27.393806 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.393747    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"]
Nov 04 06:02:27.396787 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.396747    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"]
Nov 04 06:02:27.406650 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.406619    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:27.417546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.417508    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szmp2\" (UniqueName: \"kubernetes.io/projected/543d73c4-a235-4f9e-8097-924960b6cb8e-kube-api-access-szmp2\") pod \"payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf\" (UID: \"543d73c4-a235-4f9e-8097-924960b6cb8e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:27.417735 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.417612    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d73c4-a235-4f9e-8097-924960b6cb8e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf\" (UID: \"543d73c4-a235-4f9e-8097-924960b6cb8e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:27.461124 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.461083    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"]
Nov 04 06:02:27.518551 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.518513    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d73c4-a235-4f9e-8097-924960b6cb8e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf\" (UID: \"543d73c4-a235-4f9e-8097-924960b6cb8e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:27.518770 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.518586    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22879491-6f66-45bd-82e0-2c5266d39bc8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z\" (UID: \"22879491-6f66-45bd-82e0-2c5266d39bc8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:27.518770 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.518630    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxjnn\" (UniqueName: \"kubernetes.io/projected/22879491-6f66-45bd-82e0-2c5266d39bc8-kube-api-access-gxjnn\") pod \"payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z\" (UID: \"22879491-6f66-45bd-82e0-2c5266d39bc8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:27.518770 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.518666    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szmp2\" (UniqueName: \"kubernetes.io/projected/543d73c4-a235-4f9e-8097-924960b6cb8e-kube-api-access-szmp2\") pod \"payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf\" (UID: \"543d73c4-a235-4f9e-8097-924960b6cb8e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:27.519300 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.519277    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d73c4-a235-4f9e-8097-924960b6cb8e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf\" (UID: \"543d73c4-a235-4f9e-8097-924960b6cb8e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:27.582413 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.582335    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szmp2\" (UniqueName: \"kubernetes.io/projected/543d73c4-a235-4f9e-8097-924960b6cb8e-kube-api-access-szmp2\") pod \"payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf\" (UID: \"543d73c4-a235-4f9e-8097-924960b6cb8e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:27.592723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.592683    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:27.619610 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.619563    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22879491-6f66-45bd-82e0-2c5266d39bc8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z\" (UID: \"22879491-6f66-45bd-82e0-2c5266d39bc8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:27.619781 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.619631    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjnn\" (UniqueName: \"kubernetes.io/projected/22879491-6f66-45bd-82e0-2c5266d39bc8-kube-api-access-gxjnn\") pod \"payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z\" (UID: \"22879491-6f66-45bd-82e0-2c5266d39bc8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:27.620308 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.620286    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22879491-6f66-45bd-82e0-2c5266d39bc8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z\" (UID: \"22879491-6f66-45bd-82e0-2c5266d39bc8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:27.683247 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.683213    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxjnn\" (UniqueName: \"kubernetes.io/projected/22879491-6f66-45bd-82e0-2c5266d39bc8-kube-api-access-gxjnn\") pod \"payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z\" (UID: \"22879491-6f66-45bd-82e0-2c5266d39bc8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:27.729138 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.729093    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:27.976252 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:27.976219    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"]
Nov 04 06:02:27.978861 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:27.978827    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543d73c4_a235_4f9e_8097_924960b6cb8e.slice/crio-408ce43757b168a16f1c96484b776bf5a0ff0015d67c0972e144609bc1589275 WatchSource:0}: Error finding container 408ce43757b168a16f1c96484b776bf5a0ff0015d67c0972e144609bc1589275: Status 404 returned error can't find the container with id 408ce43757b168a16f1c96484b776bf5a0ff0015d67c0972e144609bc1589275
Nov 04 06:02:28.072521 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.072478    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf" event={"ID":"543d73c4-a235-4f9e-8097-924960b6cb8e","Type":"ContainerStarted","Data":"408ce43757b168a16f1c96484b776bf5a0ff0015d67c0972e144609bc1589275"}
Nov 04 06:02:28.116071 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.116040    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"]
Nov 04 06:02:28.118449 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:28.118418    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22879491_6f66_45bd_82e0_2c5266d39bc8.slice/crio-d3b14df00d2a5e327a56ebf537ab653271f5bc2798bef6bd69457970092a40c4 WatchSource:0}: Error finding container d3b14df00d2a5e327a56ebf537ab653271f5bc2798bef6bd69457970092a40c4: Status 404 returned error can't find the container with id d3b14df00d2a5e327a56ebf537ab653271f5bc2798bef6bd69457970092a40c4
Nov 04 06:02:28.288674 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.288596    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"]
Nov 04 06:02:28.293239 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.293211    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.347898 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.347852    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-856c68-serving-cert\""
Nov 04 06:02:28.355295 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.355263    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"]
Nov 04 06:02:28.428418 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.428372    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.428603 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.428488    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l7rz\" (UniqueName: \"kubernetes.io/projected/16268c2b-9813-4248-87cf-77890439be44-kube-api-access-7l7rz\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.428603 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.428539    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16268c2b-9813-4248-87cf-77890439be44-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.428687 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.428646    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-metrics-certs\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.529826 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.529783    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.530053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.529868    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l7rz\" (UniqueName: \"kubernetes.io/projected/16268c2b-9813-4248-87cf-77890439be44-kube-api-access-7l7rz\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.530053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.529946    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16268c2b-9813-4248-87cf-77890439be44-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.530053 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:28.529961    4497 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-serving-cert: secret "maas-api-e2e-worker-w4-856c68-serving-cert" not found
Nov 04 06:02:28.530053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.530020    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-metrics-certs\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.530053 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:28.530042    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls podName:16268c2b-9813-4248-87cf-77890439be44 nodeName:}" failed. No retries permitted until 2026-11-04 06:02:29.030017938 +0000 UTC m=+796.961215336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls") pod "maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97" (UID: "16268c2b-9813-4248-87cf-77890439be44") : secret "maas-api-e2e-worker-w4-856c68-serving-cert" not found
Nov 04 06:02:28.530735 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.530713    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16268c2b-9813-4248-87cf-77890439be44-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.532809 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.532785    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-metrics-certs\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.537778 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.537731    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:28.599172 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.595439    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l7rz\" (UniqueName: \"kubernetes.io/projected/16268c2b-9813-4248-87cf-77890439be44-kube-api-access-7l7rz\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:28.705592 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.705551    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:28.853313 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:28.853218    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:29.035167 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:29.035121    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:29.037763 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:29.037742    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls\") pod \"maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:29.080456 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:29.080409    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z" event={"ID":"22879491-6f66-45bd-82e0-2c5266d39bc8","Type":"ContainerStarted","Data":"d3b14df00d2a5e327a56ebf537ab653271f5bc2798bef6bd69457970092a40c4"}
Nov 04 06:02:29.206959 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:29.206851    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:29.615589 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:29.615321    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"]
Nov 04 06:02:29.618559 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:29.618524    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16268c2b_9813_4248_87cf_77890439be44.slice/crio-aea7e40ae8ebc6600a6769a4457aeb3afda00f914f1efa7c34440b5a42518354 WatchSource:0}: Error finding container aea7e40ae8ebc6600a6769a4457aeb3afda00f914f1efa7c34440b5a42518354: Status 404 returned error can't find the container with id aea7e40ae8ebc6600a6769a4457aeb3afda00f914f1efa7c34440b5a42518354
Nov 04 06:02:29.633901 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:29.633851    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:29.822552 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:29.822514    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:30.087234 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:30.087196    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97" event={"ID":"16268c2b-9813-4248-87cf-77890439be44","Type":"ContainerStarted","Data":"aea7e40ae8ebc6600a6769a4457aeb3afda00f914f1efa7c34440b5a42518354"}
Nov 04 06:02:31.100838 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.100802    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97" event={"ID":"16268c2b-9813-4248-87cf-77890439be44","Type":"ContainerStarted","Data":"20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8"}
Nov 04 06:02:31.101333 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.101011    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:31.102523 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.102496    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf" event={"ID":"543d73c4-a235-4f9e-8097-924960b6cb8e","Type":"ContainerStarted","Data":"d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572"}
Nov 04 06:02:31.102725 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.102557    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:31.104177 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.104150    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z" event={"ID":"22879491-6f66-45bd-82e0-2c5266d39bc8","Type":"ContainerStarted","Data":"bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee"}
Nov 04 06:02:31.104306 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.104292    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:31.265452 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.265355    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97" podStartSLOduration=2.332939451 podStartE2EDuration="3.265341878s" totalImagesPullingTime="932.402427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:31.223220636 +0000 UTC m=+799.154418035" watchObservedRunningTime="2026-11-04 06:02:31.265341878 +0000 UTC m=+799.196539275"
Nov 04 06:02:31.347024 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.346965    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf" podStartSLOduration=1.343698418 podStartE2EDuration="4.346950424s" totalImagesPullingTime="3.003252006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:31.345163813 +0000 UTC m=+799.276361216" watchObservedRunningTime="2026-11-04 06:02:31.346950424 +0000 UTC m=+799.278147822"
Nov 04 06:02:31.466550 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:31.466489    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z" podStartSLOduration=1.598609903 podStartE2EDuration="4.466473313s" totalImagesPullingTime="2.86786341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:31.465218423 +0000 UTC m=+799.396415843" watchObservedRunningTime="2026-11-04 06:02:31.466473313 +0000 UTC m=+799.397670712"
Nov 04 06:02:33.832358 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:33.832321    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"]
Nov 04 06:02:33.835991 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:33.835971    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:33.890668 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:33.890632    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-f38f69-serving-cert\""
Nov 04 06:02:33.944781 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:33.944741    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"]
Nov 04 06:02:33.999087 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:33.999039    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-metrics-certs\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:33.999276 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:33.999183    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:33.999276 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:33.999229    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55487ae5-28ae-42a8-b08b-fd8153daa6af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:33.999276 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:33.999251    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqxkd\" (UniqueName: \"kubernetes.io/projected/55487ae5-28ae-42a8-b08b-fd8153daa6af-kube-api-access-nqxkd\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.039732 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.039701    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:34.100821 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.100786    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-metrics-certs\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.101023 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.100863    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.101023 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.100934    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55487ae5-28ae-42a8-b08b-fd8153daa6af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.101023 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.100959    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqxkd\" (UniqueName: \"kubernetes.io/projected/55487ae5-28ae-42a8-b08b-fd8153daa6af-kube-api-access-nqxkd\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.101023 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:34.100992    4497 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-serving-cert: secret "maas-api-e2e-worker-w0-f38f69-serving-cert" not found
Nov 04 06:02:34.101239 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:34.101066    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls podName:55487ae5-28ae-42a8-b08b-fd8153daa6af nodeName:}" failed. No retries permitted until 2026-11-04 06:02:34.601047854 +0000 UTC m=+802.532245245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls") pod "maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd" (UID: "55487ae5-28ae-42a8-b08b-fd8153daa6af") : secret "maas-api-e2e-worker-w0-f38f69-serving-cert" not found
Nov 04 06:02:34.101681 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.101658    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55487ae5-28ae-42a8-b08b-fd8153daa6af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.103528 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.103505    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-metrics-certs\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.164779 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.164743    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqxkd\" (UniqueName: \"kubernetes.io/projected/55487ae5-28ae-42a8-b08b-fd8153daa6af-kube-api-access-nqxkd\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.212233 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.212197    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:34.358103 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.358010    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:34.610162 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.606281    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.610162 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.609525    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:34.748814 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:34.748772    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:35.133937 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:35.133910    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"]
Nov 04 06:02:35.136289 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:35.136257    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55487ae5_28ae_42a8_b08b_fd8153daa6af.slice/crio-740a06c92d13b21a01ab0a7a84b6d7a6960dd81762229c0bfd1c5b9e8ab987be WatchSource:0}: Error finding container 740a06c92d13b21a01ab0a7a84b6d7a6960dd81762229c0bfd1c5b9e8ab987be: Status 404 returned error can't find the container with id 740a06c92d13b21a01ab0a7a84b6d7a6960dd81762229c0bfd1c5b9e8ab987be
Nov 04 06:02:36.130676 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:36.130637    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd" event={"ID":"55487ae5-28ae-42a8-b08b-fd8153daa6af","Type":"ContainerStarted","Data":"eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310"}
Nov 04 06:02:36.130840 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:36.130690    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd" event={"ID":"55487ae5-28ae-42a8-b08b-fd8153daa6af","Type":"ContainerStarted","Data":"740a06c92d13b21a01ab0a7a84b6d7a6960dd81762229c0bfd1c5b9e8ab987be"}
Nov 04 06:02:36.130840 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:36.130767    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:36.265241 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:36.265138    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd" podStartSLOduration=2.435315209 podStartE2EDuration="3.265117937s" totalImagesPullingTime="829.802728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:36.26307464 +0000 UTC m=+804.194272054" watchObservedRunningTime="2026-11-04 06:02:36.265117937 +0000 UTC m=+804.196315329"
Nov 04 06:02:37.120176 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:37.120142    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:02:37.550058 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:37.549974    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:37.741320 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:37.741286    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:39.325198 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.325163    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"]
Nov 04 06:02:39.328903 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.328865    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.383665 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.383635    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-db31ef-serving-cert\""
Nov 04 06:02:39.438282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.438244    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"]
Nov 04 06:02:39.473186 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.473154    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/677978a9-0d38-49af-8e20-2f622a22661f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.473345 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.473197    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.473345 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.473302    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z97kj\" (UniqueName: \"kubernetes.io/projected/677978a9-0d38-49af-8e20-2f622a22661f-kube-api-access-z97kj\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.473345 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.473336    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-metrics-certs\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.574809 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.574774    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/677978a9-0d38-49af-8e20-2f622a22661f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.575012 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.574830    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.575012 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.574907    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z97kj\" (UniqueName: \"kubernetes.io/projected/677978a9-0d38-49af-8e20-2f622a22661f-kube-api-access-z97kj\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.575012 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.574938    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-metrics-certs\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.575449 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:39.575386    4497 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-serving-cert: secret "maas-api-e2e-worker-w2-db31ef-serving-cert" not found
Nov 04 06:02:39.575631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.575597    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/677978a9-0d38-49af-8e20-2f622a22661f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.575988 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:39.575962    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls podName:677978a9-0d38-49af-8e20-2f622a22661f nodeName:}" failed. No retries permitted until 2026-11-04 06:02:40.075937168 +0000 UTC m=+808.007134555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls") pod "maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h" (UID: "677978a9-0d38-49af-8e20-2f622a22661f") : secret "maas-api-e2e-worker-w2-db31ef-serving-cert" not found
Nov 04 06:02:39.578662 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.578637    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-metrics-certs\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.635468 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.635434    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:39.639822 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.639796    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z97kj\" (UniqueName: \"kubernetes.io/projected/677978a9-0d38-49af-8e20-2f622a22661f-kube-api-access-z97kj\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:39.829341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.829249    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:39.974737 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:39.974696    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:40.080185 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:40.080105    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:40.082629 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:40.082607    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:40.241286 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:40.241251    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:40.423655 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:40.423610    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:40.624577 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:40.624540    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:40.626184 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:40.626159    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"]
Nov 04 06:02:40.628070 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:40.628043    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677978a9_0d38_49af_8e20_2f622a22661f.slice/crio-ad95d62fb0026b42682051182d257a355937734f4af5ad71f75aca6af660e844 WatchSource:0}: Error finding container ad95d62fb0026b42682051182d257a355937734f4af5ad71f75aca6af660e844: Status 404 returned error can't find the container with id ad95d62fb0026b42682051182d257a355937734f4af5ad71f75aca6af660e844
Nov 04 06:02:41.155387 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:41.155347    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h" event={"ID":"677978a9-0d38-49af-8e20-2f622a22661f","Type":"ContainerStarted","Data":"ad95d62fb0026b42682051182d257a355937734f4af5ad71f75aca6af660e844"}
Nov 04 06:02:42.123637 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:42.123593    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:02:42.124270 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:42.124250    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:02:42.141353 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:42.141331    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:02:42.161202 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:42.161171    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h" event={"ID":"677978a9-0d38-49af-8e20-2f622a22661f","Type":"ContainerStarted","Data":"c8f9faac817e32908de0f510cf6b0f339668f4d7c0b5c79a81157556e6f3688f"}
Nov 04 06:02:42.161297 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:42.161264    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:42.650224 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:42.650158    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h" podStartSLOduration=2.7304299260000002 podStartE2EDuration="3.650141213s" totalImagesPullingTime="919.711287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:42.527275329 +0000 UTC m=+810.458472726" watchObservedRunningTime="2026-11-04 06:02:42.650141213 +0000 UTC m=+810.581338618"
Nov 04 06:02:43.348063 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:43.348030    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:02:45.046122 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:45.046078    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 06:02:45.046549 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:45.046164    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 06:02:45.216241 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:45.216202    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:45.818526 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:45.818476    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:46.010273 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.010225    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:46.385583 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.385551    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"]
Nov 04 06:02:46.400571 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.400537    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:46.451809 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.451779    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"]
Nov 04 06:02:46.474905 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.474857    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79w6r\" (UniqueName: \"kubernetes.io/projected/c1515409-9b5e-48f5-8eda-5a1075d1135f-kube-api-access-79w6r\") pod \"payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg\" (UID: \"c1515409-9b5e-48f5-8eda-5a1075d1135f\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:46.475080 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.475052    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1515409-9b5e-48f5-8eda-5a1075d1135f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg\" (UID: \"c1515409-9b5e-48f5-8eda-5a1075d1135f\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:46.501670 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.501452    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-6b62c0\""
Nov 04 06:02:46.501670 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.501631    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-6b62c0-dockercfg-mv5pk\""
Nov 04 06:02:46.576498 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.576467    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1515409-9b5e-48f5-8eda-5a1075d1135f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg\" (UID: \"c1515409-9b5e-48f5-8eda-5a1075d1135f\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:46.576663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.576523    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79w6r\" (UniqueName: \"kubernetes.io/projected/c1515409-9b5e-48f5-8eda-5a1075d1135f-kube-api-access-79w6r\") pod \"payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg\" (UID: \"c1515409-9b5e-48f5-8eda-5a1075d1135f\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:46.577139 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.577121    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1515409-9b5e-48f5-8eda-5a1075d1135f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg\" (UID: \"c1515409-9b5e-48f5-8eda-5a1075d1135f\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:46.640563 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.640490    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79w6r\" (UniqueName: \"kubernetes.io/projected/c1515409-9b5e-48f5-8eda-5a1075d1135f-kube-api-access-79w6r\") pod \"payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg\" (UID: \"c1515409-9b5e-48f5-8eda-5a1075d1135f\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:46.719639 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:46.719558    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:47.103412 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.103378    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"]
Nov 04 06:02:47.106239 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:47.106200    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1515409_9b5e_48f5_8eda_5a1075d1135f.slice/crio-f12d2fbf920ffd7ce59686b2568ed41a917dbbc240fd45903d0e1b445e7e9437 WatchSource:0}: Error finding container f12d2fbf920ffd7ce59686b2568ed41a917dbbc240fd45903d0e1b445e7e9437: Status 404 returned error can't find the container with id f12d2fbf920ffd7ce59686b2568ed41a917dbbc240fd45903d0e1b445e7e9437
Nov 04 06:02:47.187598 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.187569    4497 generic.go:356] "Generic (PLEG): container finished" podID="d102d6b7-9522-4824-a62b-7817609622ee" containerID="b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb" exitCode=0
Nov 04 06:02:47.187759 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.187641    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" event={"ID":"d102d6b7-9522-4824-a62b-7817609622ee","Type":"ContainerDied","Data":"b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb"}
Nov 04 06:02:47.188090 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.188073    4497 scope.go:122] "RemoveContainer" containerID="b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb"
Nov 04 06:02:47.189583 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.189537    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:47.189685 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.189626    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:47.189685 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.189669    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:47.189794 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.189696    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg" event={"ID":"c1515409-9b5e-48f5-8eda-5a1075d1135f","Type":"ContainerStarted","Data":"1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d"}
Nov 04 06:02:47.189794 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.189742    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg" event={"ID":"c1515409-9b5e-48f5-8eda-5a1075d1135f","Type":"ContainerStarted","Data":"f12d2fbf920ffd7ce59686b2568ed41a917dbbc240fd45903d0e1b445e7e9437"}
Nov 04 06:02:47.189794 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.189789    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:47.443147 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:47.443031    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg" podStartSLOduration=1.443010816 podStartE2EDuration="1.443010816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:47.436519401 +0000 UTC m=+815.367716800" watchObservedRunningTime="2026-11-04 06:02:47.443010816 +0000 UTC m=+815.374208218"
Nov 04 06:02:48.170928 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:48.170896    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:02:48.197244 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:48.197200    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" event={"ID":"d102d6b7-9522-4824-a62b-7817609622ee","Type":"ContainerStarted","Data":"35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361"}
Nov 04 06:02:48.690435 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:48.690401    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:48.894971 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:48.894934    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:49.136483 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:49.136440    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:49.136794 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:49.136772    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Nov 04 06:02:49.136852 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:49.136829    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Nov 04 06:02:50.136671 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.136634    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Nov 04 06:02:50.137115 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.136710    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Nov 04 06:02:50.385978 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.385941    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"]
Nov 04 06:02:50.393763 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.393705    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.445988 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.445952    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-metrics-certs\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.446161 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.445999    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.446203 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.446168    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf953974-421f-4bf7-97d9-6e0c738f1b42-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.446243 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.446220    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4nw\" (UniqueName: \"kubernetes.io/projected/cf953974-421f-4bf7-97d9-6e0c738f1b42-kube-api-access-fb4nw\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.523052 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.509353    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"]
Nov 04 06:02:50.523052 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.520711    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-32f7d6-serving-cert\""
Nov 04 06:02:50.547389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.547353    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf953974-421f-4bf7-97d9-6e0c738f1b42-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.547584 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.547433    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4nw\" (UniqueName: \"kubernetes.io/projected/cf953974-421f-4bf7-97d9-6e0c738f1b42-kube-api-access-fb4nw\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.547584 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.547494    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-metrics-certs\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.547584 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.547524    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.547748 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:50.547670    4497 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-serving-cert: secret "maas-api-e2e-worker-w3-32f7d6-serving-cert" not found
Nov 04 06:02:50.547748 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:02:50.547734    4497 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls podName:cf953974-421f-4bf7-97d9-6e0c738f1b42 nodeName:}" failed. No retries permitted until 2026-11-04 06:02:51.047712859 +0000 UTC m=+818.978910257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls") pod "maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn" (UID: "cf953974-421f-4bf7-97d9-6e0c738f1b42") : secret "maas-api-e2e-worker-w3-32f7d6-serving-cert" not found
Nov 04 06:02:50.548911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.548852    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf953974-421f-4bf7-97d9-6e0c738f1b42-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.551158 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.551132    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-metrics-certs\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.623557 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.623521    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:50.627577 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.627541    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4nw\" (UniqueName: \"kubernetes.io/projected/cf953974-421f-4bf7-97d9-6e0c738f1b42-kube-api-access-fb4nw\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:50.781957 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.781832    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:50.926861 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:50.926810    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:51.052855 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:51.052751    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:51.055325 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:51.055296    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls\") pod \"maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:51.135955 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:51.135873    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Nov 04 06:02:51.136137 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:51.135987    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Nov 04 06:02:51.332605 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:51.332500    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:51.724147 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:51.724112    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"]
Nov 04 06:02:51.725744 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:51.725715    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf953974_421f_4bf7_97d9_6e0c738f1b42.slice/crio-9c3c8a440cee9d761dc20fce5ba684eba1cd94ba799e6866839e9743bc90a237 WatchSource:0}: Error finding container 9c3c8a440cee9d761dc20fce5ba684eba1cd94ba799e6866839e9743bc90a237: Status 404 returned error can't find the container with id 9c3c8a440cee9d761dc20fce5ba684eba1cd94ba799e6866839e9743bc90a237
Nov 04 06:02:52.136578 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:52.136546    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Nov 04 06:02:52.136789 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:52.136591    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Nov 04 06:02:52.240037 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:52.239999    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn" event={"ID":"cf953974-421f-4bf7-97d9-6e0c738f1b42","Type":"ContainerStarted","Data":"9c3c8a440cee9d761dc20fce5ba684eba1cd94ba799e6866839e9743bc90a237"}
Nov 04 06:02:53.136016 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:53.135972    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Nov 04 06:02:53.136501 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:53.136026    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Nov 04 06:02:53.246557 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:53.246518    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn" event={"ID":"cf953974-421f-4bf7-97d9-6e0c738f1b42","Type":"ContainerStarted","Data":"fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431"}
Nov 04 06:02:53.246741 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:53.246648    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:53.371521 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:53.371353    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn" podStartSLOduration=2.525708637 podStartE2EDuration="3.371334755s" totalImagesPullingTime="845.626118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:53.370447672 +0000 UTC m=+821.301645093" watchObservedRunningTime="2026-11-04 06:02:53.371334755 +0000 UTC m=+821.302532154"
Nov 04 06:02:54.139805 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:54.139775    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:54.140316 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:54.140088    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:54.140809 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:54.140789    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:02:56.174112 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:56.174077    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:56.369408 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:56.369377    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:56.516987 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:56.516905    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:02:57.774714 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.774678    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"]
Nov 04 06:02:57.778190 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.778168    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.838445 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.838417    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-f38f69-openshift-default-dockercfg-4859w\""
Nov 04 06:02:57.889712 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.889679    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"]
Nov 04 06:02:57.926656 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.926618    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.926656 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.926656    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.926860 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.926740    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.926860 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.926779    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.926957 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.926870    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.926957 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.926942    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z4fw\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-kube-api-access-7z4fw\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.927030 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.927005    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.927030 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.927021    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:57.927136 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:57.927107    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.028840 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.028753    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.028840 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.028790    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029062 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.028927    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029062 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.028973    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029062 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.028991    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029062 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029030    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029239 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029069    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029239 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029112    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029239 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029146    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z4fw\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-kube-api-access-7z4fw\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029365 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029267    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029510 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029487    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029681 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029656    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029749 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029656    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.029749 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.029704    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.031484 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.031454    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.031665 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.031645    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.092636 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.092590    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.092774 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.092686    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z4fw\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-kube-api-access-7z4fw\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.200458 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.200427    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:02:58.391323 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.391296    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:58.873914 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.873839    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"]
Nov 04 06:02:58.876052 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:02:58.876017    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2767f02f_a2e7_4088_809c_b3c4a7c12b8f.slice/crio-04a5ed1c2af496bf122f233661630d7cfa6ff3f23f971adb12847c533fd7f844 WatchSource:0}: Error finding container 04a5ed1c2af496bf122f233661630d7cfa6ff3f23f971adb12847c533fd7f844: Status 404 returned error can't find the container with id 04a5ed1c2af496bf122f233661630d7cfa6ff3f23f971adb12847c533fd7f844
Nov 04 06:02:58.878311 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.878277    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:58.878371 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.878348    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:58.878411 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:58.878379    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:02:59.257119 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:59.257032    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:02:59.278728 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:59.278689    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" event={"ID":"2767f02f-a2e7-4088-809c-b3c4a7c12b8f","Type":"ContainerStarted","Data":"d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b"}
Nov 04 06:02:59.279091 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:59.278755    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" event={"ID":"2767f02f-a2e7-4088-809c-b3c4a7c12b8f","Type":"ContainerStarted","Data":"04a5ed1c2af496bf122f233661630d7cfa6ff3f23f971adb12847c533fd7f844"}
Nov 04 06:02:59.393983 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:59.393949    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:02:59.397913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:59.395457    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Nov 04 06:02:59.397913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:59.395512    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Nov 04 06:02:59.532827 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:02:59.532642    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podStartSLOduration=2.532628139 podStartE2EDuration="2.532628139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:59.530830471 +0000 UTC m=+827.462027880" watchObservedRunningTime="2026-11-04 06:02:59.532628139 +0000 UTC m=+827.463825536"
Nov 04 06:03:00.392723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:00.392692    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Nov 04 06:03:00.393211 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:00.393181    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Nov 04 06:03:01.392498 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:01.392455    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Nov 04 06:03:01.392715 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:01.392535    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Nov 04 06:03:01.825974 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:01.825408    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:01.991873 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:01.991842    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:02.281368 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:02.281331    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:02.392441 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:02.392411    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Nov 04 06:03:02.392587 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:02.392471    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Nov 04 06:03:03.392244 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:03.392206    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Nov 04 06:03:03.392737 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:03.392285    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Nov 04 06:03:04.391757 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:04.391724    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Nov 04 06:03:04.391998 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:04.391950    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Nov 04 06:03:05.396427 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:05.396395    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:03:05.396849 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:05.396683    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:03:05.397453 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:05.397433    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:03:07.059999 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:07.059959    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:07.493609 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:07.493573    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:09.365073 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:09.365039    4497 generic.go:356] "Generic (PLEG): container finished" podID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerID="45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81" exitCode=0
Nov 04 06:03:09.365528 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:09.365089    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" event={"ID":"f225a8f6-5390-429f-9dbc-d2cd97e7303c","Type":"ContainerDied","Data":"45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81"}
Nov 04 06:03:09.365528 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:09.365404    4497 scope.go:122] "RemoveContainer" containerID="45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81"
Nov 04 06:03:09.366609 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:09.366581    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:09.366678 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:09.366647    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:09.366716 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:09.366680    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:10.371699 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:10.371665    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" event={"ID":"f225a8f6-5390-429f-9dbc-d2cd97e7303c","Type":"ContainerStarted","Data":"a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c"}
Nov 04 06:03:11.240147 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:11.240115    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:03:11.241292 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:11.241265    4497 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 04 06:03:11.241400 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:11.241326    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 04 06:03:12.241550 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:12.241514    4497 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 04 06:03:12.242185 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:12.242155    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 04 06:03:12.663103 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:12.660561    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:12.826910 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:12.826193    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:13.018971 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:13.018421    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:13.240348 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:13.240306    4497 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 04 06:03:13.240639 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:13.240608    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 04 06:03:13.372935 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:03:13.372879    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:03:14.257001 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:14.256957    4497 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 04 06:03:14.257379 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:14.257348    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 04 06:03:14.349493 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:14.349451    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:14.495736 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:14.495707    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:15.015912 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:15.014994    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:03:15.240912 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:15.240258    4497 patch_prober.go:29] interesting pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 04 06:03:15.240912 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:15.240335    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 04 06:03:16.244381 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:16.244345    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:03:16.245203 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:16.245182    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:03:17.035380 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:17.035349    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:17.678299 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:17.678262    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:17.820744 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:17.820705    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:18.330060 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:18.329975    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:21.001180 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:21.001149    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:21.450804 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:21.450766    4497 generic.go:356] "Generic (PLEG): container finished" podID="7df4bacd-8439-4779-84c8-322435514bad" containerID="228cb78ca2728876aa6d5059694c29ba7c8ebf0fb076c8e49737cd54ac560cae" exitCode=0
Nov 04 06:03:21.451035 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:21.450819    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" event={"ID":"7df4bacd-8439-4779-84c8-322435514bad","Type":"ContainerDied","Data":"228cb78ca2728876aa6d5059694c29ba7c8ebf0fb076c8e49737cd54ac560cae"}
Nov 04 06:03:21.451326 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:21.451306    4497 scope.go:122] "RemoveContainer" containerID="228cb78ca2728876aa6d5059694c29ba7c8ebf0fb076c8e49737cd54ac560cae"
Nov 04 06:03:21.452743 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:21.452712    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:21.452839 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:21.452782    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:21.452924 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:21.452837    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:22.457780 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:22.457744    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" event={"ID":"7df4bacd-8439-4779-84c8-322435514bad","Type":"ContainerStarted","Data":"3bbabe3f05ad70b1707ad9f7733e4a701690fe59ca90597e7f31632ffdd24705"}
Nov 04 06:03:23.291934 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:23.291838    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:03:23.292142 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:23.292117    4497 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 04 06:03:23.292222 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:23.292183    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 04 06:03:23.429082 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:23.429042    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:24.291947 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:24.291880    4497 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 04 06:03:24.292322 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:24.291966    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 04 06:03:25.291955 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:25.291923    4497 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 04 06:03:25.292434 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:25.291976    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 04 06:03:26.292292 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:26.292256    4497 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 04 06:03:26.292678 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:26.292328    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 04 06:03:27.292848 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:27.292803    4497 patch_prober.go:29] interesting pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 04 06:03:27.293278 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:27.292882    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 04 06:03:28.197397 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:28.197362    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:28.296266 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:28.296238    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:03:28.296716 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:28.296532    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:03:28.297312 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:28.297297    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:03:28.807792 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:28.807749    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:28.958947 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:28.958907    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:29.105604 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:29.105566    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:29.660868 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:29.660834    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:30.364543 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:30.364514    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:30.513560 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:30.513521    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:33.112478 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:33.112442    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:34.414460 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:34.414426    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:39.826452 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:39.826418    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:43.095047 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.095009    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"]
Nov 04 06:03:43.099680 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.099662    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.164919 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.164859    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"]
Nov 04 06:03:43.229344 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229307    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec73258-37f3-4280-b233-59fafcaddef2-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.229512 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229420    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.229512 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229459    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.229587 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229539    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.229620 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229584    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec73258-37f3-4280-b233-59fafcaddef2-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.229658 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229622    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.229693 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229686    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.229726 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229702    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk74b\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-kube-api-access-kk74b\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.229726 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.229721    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.326424 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:03:43.326387    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:03:43.331000 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.330981    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331067 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331009    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk74b\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-kube-api-access-kk74b\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331067 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331028    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331168 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331148    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec73258-37f3-4280-b233-59fafcaddef2-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331248 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331236    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331303 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331266    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331303 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331294    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331388 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331329    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec73258-37f3-4280-b233-59fafcaddef2-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331388 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331379    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331485 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331387    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331485 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331417    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331697    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331817 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331744    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.331901 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.331851    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec73258-37f3-4280-b233-59fafcaddef2-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.333502 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.333478    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.333784 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.333764    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec73258-37f3-4280-b233-59fafcaddef2-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.394973 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.394874    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk74b\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-kube-api-access-kk74b\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.395257 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.395236    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.413272 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.413245    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:43.758568 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.758483    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:43.858431 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.858404    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"]
Nov 04 06:03:43.860365 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:03:43.860341    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec73258_37f3_4280_b233_59fafcaddef2.slice/crio-b68b22147010229ecb852c56f4166b2cb8534c86d6e3678a1e9c968f071b2f33 WatchSource:0}: Error finding container b68b22147010229ecb852c56f4166b2cb8534c86d6e3678a1e9c968f071b2f33: Status 404 returned error can't find the container with id b68b22147010229ecb852c56f4166b2cb8534c86d6e3678a1e9c968f071b2f33
Nov 04 06:03:43.862724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.862692    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:43.862777 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.862759    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:43.862812 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:43.862786    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:03:44.363009 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:44.362978    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:44.526904 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:44.526847    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:44.561106 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:44.561075    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" event={"ID":"2ec73258-37f3-4280-b233-59fafcaddef2","Type":"ContainerStarted","Data":"d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563"}
Nov 04 06:03:44.561295 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:44.561145    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" event={"ID":"2ec73258-37f3-4280-b233-59fafcaddef2","Type":"ContainerStarted","Data":"b68b22147010229ecb852c56f4166b2cb8534c86d6e3678a1e9c968f071b2f33"}
Nov 04 06:03:44.678509 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:44.678420    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:44.742678 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:44.742626    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" podStartSLOduration=1.7426133990000001 podStartE2EDuration="1.742613399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:03:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:03:44.74216863 +0000 UTC m=+872.673366029" watchObservedRunningTime="2026-11-04 06:03:44.742613399 +0000 UTC m=+872.673810794"
Nov 04 06:03:45.333592 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:45.333562    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:45.416982 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:45.416946    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:45.421001 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:45.420974    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Nov 04 06:03:45.421189 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:45.421163    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Nov 04 06:03:46.417260 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:46.417224    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Nov 04 06:03:46.417834 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:46.417803    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Nov 04 06:03:47.421911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:47.421293    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Nov 04 06:03:47.421911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:47.421368    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Nov 04 06:03:48.421911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:48.418813    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Nov 04 06:03:48.421911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:48.418873    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Nov 04 06:03:48.762525 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:48.762445    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:49.082796 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:49.082702    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:49.421913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:49.418205    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Nov 04 06:03:49.421913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:49.418272    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Nov 04 06:03:49.777482 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:49.777393    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:49.936363 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:49.936330    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:50.417913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:50.417873    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:50.418166 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:50.418146    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:50.418923 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:50.418905    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:03:50.760493 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:50.760394    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:55.028098 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:55.028048    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:55.559913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:55.557224    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:55.701305 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:55.701262    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:55.853153 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:55.853124    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:56.445191 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:56.445154    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:59.473942 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.473897    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"]
Nov 04 06:03:59.477814 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.477787    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.562705 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.562671    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:03:59.585091 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.585063    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"kube-root-ca.crt\""
Nov 04 06:03:59.585229 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.585095    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"openshift-service-ca.crt\""
Nov 04 06:03:59.585229 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.585123    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"simulator-w2-db31ef-kserve-self-signed-certs\""
Nov 04 06:03:59.585229 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.585130    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"default-dockercfg-v4btb\""
Nov 04 06:03:59.587429 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.587408    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"]
Nov 04 06:03:59.605631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.605604    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tls-certs\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.605724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.605674    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-dshm\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.605769 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.605732    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-model-cache\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.605811 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.605777    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926hx\" (UniqueName: \"kubernetes.io/projected/3a6a626b-174f-44ac-9618-ae8dcbc568eb-kube-api-access-926hx\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.605952 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.605935    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-home\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.606027 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.605992    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tmp-dir\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707057 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707020    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926hx\" (UniqueName: \"kubernetes.io/projected/3a6a626b-174f-44ac-9618-ae8dcbc568eb-kube-api-access-926hx\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707235 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707090    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-home\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707235 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707121    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tmp-dir\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707235 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707141    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tls-certs\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707235 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707197    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-dshm\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707235 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707223    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-model-cache\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707531 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707507    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-home\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707595 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707567    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tmp-dir\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.707595 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.707586    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-model-cache\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.709573 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.709550    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-dshm\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.709855 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.709834    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tls-certs\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.770451 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.770391    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-926hx\" (UniqueName: \"kubernetes.io/projected/3a6a626b-174f-44ac-9618-ae8dcbc568eb-kube-api-access-926hx\") pod \"simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") " pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:03:59.790341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:03:59.790307    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:04:00.171547 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:00.171523    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"]
Nov 04 06:04:00.173974 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:04:00.173947    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a6a626b_174f_44ac_9618_ae8dcbc568eb.slice/crio-bdb89ebccdcb112350822389708714c189cefe98f70f69928d8a4c437b344ed0 WatchSource:0}: Error finding container bdb89ebccdcb112350822389708714c189cefe98f70f69928d8a4c437b344ed0: Status 404 returned error can't find the container with id bdb89ebccdcb112350822389708714c189cefe98f70f69928d8a4c437b344ed0
Nov 04 06:04:00.641098 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:00.641066    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x" event={"ID":"3a6a626b-174f-44ac-9618-ae8dcbc568eb","Type":"ContainerStarted","Data":"5f9dd8cc8d0ee5fea7ec57e3bdf225551a62c3f9465de1289bd29f26ac386351"}
Nov 04 06:04:00.641501 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:00.641104    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x" event={"ID":"3a6a626b-174f-44ac-9618-ae8dcbc568eb","Type":"ContainerStarted","Data":"bdb89ebccdcb112350822389708714c189cefe98f70f69928d8a4c437b344ed0"}
Nov 04 06:04:00.765693 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:00.765648    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x" podStartSLOduration=1.7656352499999999 podStartE2EDuration="1.76563525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:03:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:04:00.764507871 +0000 UTC m=+888.695705268" watchObservedRunningTime="2026-11-04 06:04:00.76563525 +0000 UTC m=+888.696832646"
Nov 04 06:04:00.790709 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:00.790682    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:04:01.603982 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:01.603953    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:04.947218 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:04.947174    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:05.442308 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:05.442266    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:06.092465 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:06.092433    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:06.299799 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:06.299716    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:07.016827 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:07.016794    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:08.125492 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:08.125451    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:09.790438 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:09.790407    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:04:09.802917 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:09.802869    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:04:10.698743 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:10.698715    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:04:12.099896 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:12.099846    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:13.327242 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:04:13.327205    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:04:17.197850 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:17.197818    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:21.915232 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:21.915194    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"]
Nov 04 06:04:21.919858 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:21.919841    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:21.944241 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:21.944215    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tls-certs\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:21.944360 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:21.944342    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-dshm\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:21.944445 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:21.944428    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-model-cache\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:21.944546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:21.944528    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtrl2\" (UniqueName: \"kubernetes.io/projected/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-kube-api-access-xtrl2\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:21.944606 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:21.944564    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-home\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:21.944646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:21.944626    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tmp-dir\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.006067 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.006041    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:22.028093 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.028063    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-18990c\"/\"openshift-service-ca.crt\""
Nov 04 06:04:22.028298 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.028281    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-18990c\"/\"kube-root-ca.crt\""
Nov 04 06:04:22.028298 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.028293    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-18990c\"/\"default-dockercfg-wpsdm\""
Nov 04 06:04:22.028416 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.028367    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-18990c\"/\"simulator-w6-18990c-kserve-self-signed-certs\""
Nov 04 06:04:22.030395 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.030377    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"]
Nov 04 06:04:22.045875 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.045848    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrl2\" (UniqueName: \"kubernetes.io/projected/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-kube-api-access-xtrl2\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.045948 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.045907    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-home\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.045948 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.045928    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tmp-dir\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.046037 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.045971    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tls-certs\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.046037 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.046035    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-dshm\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.046130 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.046090    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-model-cache\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.046320 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.046301    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tmp-dir\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.046396 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.046354    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-home\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.046450 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.046432    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-model-cache\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.048392 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.048364    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-dshm\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.048574 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.048562    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tls-certs\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.143598 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.143569    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtrl2\" (UniqueName: \"kubernetes.io/projected/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-kube-api-access-xtrl2\") pod \"simulator-w6-18990c-kserve-5bf4457787-kk2tg\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") " pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.230924 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.230838    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:22.297225 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.297190    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:22.612011 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.611990    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"]
Nov 04 06:04:22.614755 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:04:22.614730    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb3b3a38_7ac6_4626_aa33_712b8c95bc26.slice/crio-459813f140d345b5b9338d8011e67d42ff7fb9f67dd78761e77f63d8acc8e9a9 WatchSource:0}: Error finding container 459813f140d345b5b9338d8011e67d42ff7fb9f67dd78761e77f63d8acc8e9a9: Status 404 returned error can't find the container with id 459813f140d345b5b9338d8011e67d42ff7fb9f67dd78761e77f63d8acc8e9a9
Nov 04 06:04:22.745381 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.745352    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg" event={"ID":"fb3b3a38-7ac6-4626-aa33-712b8c95bc26","Type":"ContainerStarted","Data":"02113c3ed2a8bb7755c314373b2300a79f7ea721d8ae704e6538299255f7d518"}
Nov 04 06:04:22.745553 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.745394    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg" event={"ID":"fb3b3a38-7ac6-4626-aa33-712b8c95bc26","Type":"ContainerStarted","Data":"459813f140d345b5b9338d8011e67d42ff7fb9f67dd78761e77f63d8acc8e9a9"}
Nov 04 06:04:22.867903 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:22.867773    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg" podStartSLOduration=1.8677573509999998 podStartE2EDuration="1.867757351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:04:22.866140879 +0000 UTC m=+910.797338275" watchObservedRunningTime="2026-11-04 06:04:22.867757351 +0000 UTC m=+910.798954749"
Nov 04 06:04:23.231737 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:23.231663    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:27.411390 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:27.411357    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:27.754699 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:27.754615    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:32.231716 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:32.231687    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:32.243492 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:32.243469    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:32.499653 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:32.499576    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:32.801524 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:32.801439    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:04:33.069979 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.069873    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"]
Nov 04 06:04:33.073812 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.073788    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.128724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.128696    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-356418\"/\"openshift-service-ca.crt\""
Nov 04 06:04:33.128724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.128709    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-356418\"/\"default-dockercfg-vsd7z\""
Nov 04 06:04:33.128724 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.128715    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-356418\"/\"simulator-w1-356418-kserve-self-signed-certs\""
Nov 04 06:04:33.128941 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.128737    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-356418\"/\"kube-root-ca.crt\""
Nov 04 06:04:33.135716 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.135693    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"]
Nov 04 06:04:33.159947 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.159925    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc2e580f-51db-4076-93c3-6240feef04d8-tls-certs\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.160067 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.159976    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl5x4\" (UniqueName: \"kubernetes.io/projected/bc2e580f-51db-4076-93c3-6240feef04d8-kube-api-access-dl5x4\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.160135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.160120    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-home\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.160248 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.160231    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-dshm\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.160305 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.160294    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-model-cache\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.160443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.160421    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-tmp-dir\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.160813 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.160787    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:33.261993 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.261956    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-home\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.262394 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.262070    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-dshm\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.262394 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.262244    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-model-cache\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.262394 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.262341    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-tmp-dir\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.262577 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.262395    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-home\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.262577 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.262458    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc2e580f-51db-4076-93c3-6240feef04d8-tls-certs\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.262577 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.262539    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl5x4\" (UniqueName: \"kubernetes.io/projected/bc2e580f-51db-4076-93c3-6240feef04d8-kube-api-access-dl5x4\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.262732 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.262580    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-model-cache\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.262822 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.262804    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-tmp-dir\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.264423 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.264403    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-dshm\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.264861 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.264844    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc2e580f-51db-4076-93c3-6240feef04d8-tls-certs\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.325600 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.325551    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl5x4\" (UniqueName: \"kubernetes.io/projected/bc2e580f-51db-4076-93c3-6240feef04d8-kube-api-access-dl5x4\") pod \"simulator-w1-356418-kserve-6c488c44f-6chlk\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") " pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.387713 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.387689    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:33.770640 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.770616    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"]
Nov 04 06:04:33.773018 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:04:33.772991    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc2e580f_51db_4076_93c3_6240feef04d8.slice/crio-7a89e68ffd29bff4be4631898d0fc43a2143753dbfd755d8a738722a00e8447a WatchSource:0}: Error finding container 7a89e68ffd29bff4be4631898d0fc43a2143753dbfd755d8a738722a00e8447a: Status 404 returned error can't find the container with id 7a89e68ffd29bff4be4631898d0fc43a2143753dbfd755d8a738722a00e8447a
Nov 04 06:04:33.795988 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:33.795959    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk" event={"ID":"bc2e580f-51db-4076-93c3-6240feef04d8","Type":"ContainerStarted","Data":"7a89e68ffd29bff4be4631898d0fc43a2143753dbfd755d8a738722a00e8447a"}
Nov 04 06:04:34.802775 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:34.802744    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk" event={"ID":"bc2e580f-51db-4076-93c3-6240feef04d8","Type":"ContainerStarted","Data":"ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea"}
Nov 04 06:04:34.924463 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:34.924407    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk" podStartSLOduration=1.924387898 podStartE2EDuration="1.924387898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:04:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:04:34.92352711 +0000 UTC m=+922.854724506" watchObservedRunningTime="2026-11-04 06:04:34.924387898 +0000 UTC m=+922.855585329"
Nov 04 06:04:35.388189 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:35.388161    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:37.655974 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:37.655939    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:42.697987 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:42.697950    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:43.326539 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:04:43.326492    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:04:43.388212 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:43.388181    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:43.400398 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:43.400371    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:43.866414 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:43.866386    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:04:44.608201 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:44.608171    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:47.796338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:47.796303    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:52.493523 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:52.493486    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:52.640831 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:52.640805    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:52.823042 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:52.822966    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:57.818105 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:57.818030    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:04:57.999089 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:04:57.999057    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:02.991644 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:02.991605    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:07.816029 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:07.815994    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:08.016618 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:08.016583    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:13.097295 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:13.097259    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:13.326417 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:05:13.326377    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:05:18.201747 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:18.201714    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:23.314848 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:23.314811    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:26.108046 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:26.108009    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:28.411739 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:28.411701    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:33.502007 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:33.501973    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:36.845779 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.845748    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"]
Nov 04 06:05:36.849324 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.849305    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:36.938287 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.938249    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:36.956443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.956419    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-32f7d6\"/\"kube-root-ca.crt\""
Nov 04 06:05:36.956642 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.956625    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-32f7d6\"/\"openshift-service-ca.crt\""
Nov 04 06:05:36.956728 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.956667    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-32f7d6\"/\"default-dockercfg-wf5hh\""
Nov 04 06:05:36.956728 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.956688    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-32f7d6\"/\"premium-w3-32f7d6-kserve-self-signed-certs\""
Nov 04 06:05:36.958762 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.958743    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"]
Nov 04 06:05:36.999963 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:36.999860    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-tmp-dir\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.000158 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.000026    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0b32921-0b5d-4955-ab47-0a3086d20557-tls-certs\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.000158 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.000087    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-home\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.000296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.000161    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltq9\" (UniqueName: \"kubernetes.io/projected/a0b32921-0b5d-4955-ab47-0a3086d20557-kube-api-access-8ltq9\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.000296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.000199    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-model-cache\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.000370 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.000310    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-dshm\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.101433 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101344    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-dshm\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.101433 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101425    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-tmp-dir\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.101651 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101475    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0b32921-0b5d-4955-ab47-0a3086d20557-tls-certs\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.101651 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101500    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-home\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.101651 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101547    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltq9\" (UniqueName: \"kubernetes.io/projected/a0b32921-0b5d-4955-ab47-0a3086d20557-kube-api-access-8ltq9\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.101651 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101582    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-model-cache\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.101862 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101841    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-tmp-dir\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.101954 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101864    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-home\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.102008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.101959    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-model-cache\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.103867 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.103846    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-dshm\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.103993 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.103971    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0b32921-0b5d-4955-ab47-0a3086d20557-tls-certs\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.164670 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.164640    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltq9\" (UniqueName: \"kubernetes.io/projected/a0b32921-0b5d-4955-ab47-0a3086d20557-kube-api-access-8ltq9\") pod \"premium-w3-32f7d6-kserve-64cc8496ff-drhdp\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") " pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.460990 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.460912    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:37.857427 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:37.857405    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"]
Nov 04 06:05:37.859283 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:05:37.859244    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0b32921_0b5d_4955_ab47_0a3086d20557.slice/crio-fddb7ea48f3f84a921e422fad8e7388117ff9f63fb38866e91449b90514a60e5 WatchSource:0}: Error finding container fddb7ea48f3f84a921e422fad8e7388117ff9f63fb38866e91449b90514a60e5: Status 404 returned error can't find the container with id fddb7ea48f3f84a921e422fad8e7388117ff9f63fb38866e91449b90514a60e5
Nov 04 06:05:38.123973 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:38.123876    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp" event={"ID":"a0b32921-0b5d-4955-ab47-0a3086d20557","Type":"ContainerStarted","Data":"b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2"}
Nov 04 06:05:38.123973 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:38.123944    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp" event={"ID":"a0b32921-0b5d-4955-ab47-0a3086d20557","Type":"ContainerStarted","Data":"fddb7ea48f3f84a921e422fad8e7388117ff9f63fb38866e91449b90514a60e5"}
Nov 04 06:05:38.245075 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:38.245019    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp" podStartSLOduration=2.245004855 podStartE2EDuration="2.245004855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:05:38.244652441 +0000 UTC m=+986.175849838" watchObservedRunningTime="2026-11-04 06:05:38.245004855 +0000 UTC m=+986.176202252"
Nov 04 06:05:38.461698 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:38.461613    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:38.612714 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:38.612672    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:43.327856 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:05:43.327818    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:05:43.713590 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:43.713553    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:47.461767 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:47.461736    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:47.475298 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:47.475268    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:48.181778 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:48.181750    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:05:48.760349 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:48.760320    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:53.903657 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:53.903613    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:54.047974 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:54.047942    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:05:59.013498 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:05:59.013457    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:02.706361 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.706327    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"]
Nov 04 06:06:02.710027 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.710010    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.765108 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.765077    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-356418\"/\"premium-w1-356418-kserve-self-signed-certs\""
Nov 04 06:06:02.807455 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.807421    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:02.819507 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.819472    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"]
Nov 04 06:06:02.887224 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.887185    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c51d5a2-2962-410b-aab4-c97674ac344f-tls-certs\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.887481 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.887244    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-dshm\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.887481 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.887273    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-home\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.887481 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.887413    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlc4h\" (UniqueName: \"kubernetes.io/projected/5c51d5a2-2962-410b-aab4-c97674ac344f-kube-api-access-zlc4h\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.887602 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.887512    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-model-cache\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.887602 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.887546    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-tmp-dir\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989114 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989039    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-model-cache\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989114 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989086    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-tmp-dir\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989287 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989119    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c51d5a2-2962-410b-aab4-c97674ac344f-tls-certs\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989287 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989152    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-dshm\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989287 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989172    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-home\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989287 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989232    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlc4h\" (UniqueName: \"kubernetes.io/projected/5c51d5a2-2962-410b-aab4-c97674ac344f-kube-api-access-zlc4h\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989503 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989479    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-model-cache\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989581 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989559    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-tmp-dir\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.989635 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.989619    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-home\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.991440 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.991414    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-dshm\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:02.991674 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:02.991657    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c51d5a2-2962-410b-aab4-c97674ac344f-tls-certs\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:03.052534 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:03.052499    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlc4h\" (UniqueName: \"kubernetes.io/projected/5c51d5a2-2962-410b-aab4-c97674ac344f-kube-api-access-zlc4h\") pod \"premium-w1-356418-kserve-69887bc856-vt9zd\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") " pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:03.322601 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:03.322521    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:03.702607 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:03.702584    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"]
Nov 04 06:06:03.704805 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:06:03.704773    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c51d5a2_2962_410b_aab4_c97674ac344f.slice/crio-a4020de188f2cfe6b7dd208553e176e8741045000bb2a4678d97b3b691cf84f9 WatchSource:0}: Error finding container a4020de188f2cfe6b7dd208553e176e8741045000bb2a4678d97b3b691cf84f9: Status 404 returned error can't find the container with id a4020de188f2cfe6b7dd208553e176e8741045000bb2a4678d97b3b691cf84f9
Nov 04 06:06:04.102331 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:04.102305    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:04.250794 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:04.250761    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd" event={"ID":"5c51d5a2-2962-410b-aab4-c97674ac344f","Type":"ContainerStarted","Data":"fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29"}
Nov 04 06:06:04.250996 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:04.250809    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd" event={"ID":"5c51d5a2-2962-410b-aab4-c97674ac344f","Type":"ContainerStarted","Data":"a4020de188f2cfe6b7dd208553e176e8741045000bb2a4678d97b3b691cf84f9"}
Nov 04 06:06:04.323334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:04.323309    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:04.373554 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:04.373474    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd" podStartSLOduration=2.373460951 podStartE2EDuration="2.373460951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:06:04.371838333 +0000 UTC m=+1012.303035728" watchObservedRunningTime="2026-11-04 06:06:04.373460951 +0000 UTC m=+1012.304658348"
Nov 04 06:06:08.182275 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:08.182233    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:09.200205 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:09.200167    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:13.323251 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:13.323221    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:13.326702 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:06:13.326675    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:06:13.335317 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:13.335299    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:14.297374 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:14.297343    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:14.311592 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:14.311566    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:06:19.536809 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:19.536768    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:24.576665 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:24.576591    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:24.721979 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:24.721947    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:29.700288 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:29.700258    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:34.824588 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:34.824549    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:39.904458 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:39.904428    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:43.295508 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:43.295477    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"]
Nov 04 06:06:43.295959 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:43.295689    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy" containerID="cri-o://3ba756c807e071949cadc52bde2d8db45b99daa64507c344e963cfaa5f79e674" gracePeriod=30
Nov 04 06:06:43.326388 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:06:43.326353    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:06:45.008598 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.008561    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:45.622912 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.622868    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"]
Nov 04 06:06:45.626665 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.626650    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.681633 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.681604    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-db31ef-openshift-default-dockercfg-v5k8n\""
Nov 04 06:06:45.707985 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.707954    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.708122 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.707995    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649c17e9-7aed-4729-b567-6e3fa8fb931c-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.708122 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.708013    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.708206 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.708188    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.708242 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.708214    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.708242 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.708234    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.708341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.708262    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.708341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.708309    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p9f9\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-kube-api-access-4p9f9\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.708409 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.708394    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.739325 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.739298    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"]
Nov 04 06:06:45.809075 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809041    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809075 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809077    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809306 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809102    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809306 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809143    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809306 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809168    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p9f9\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-kube-api-access-4p9f9\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809306 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809242    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809306 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809281    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809567 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809315    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649c17e9-7aed-4729-b567-6e3fa8fb931c-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809567 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809341    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809567 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809489    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809721 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809615    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809721 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809670    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809827 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809742    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.809973 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.809952    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649c17e9-7aed-4729-b567-6e3fa8fb931c-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.811634 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.811613    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.811634 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.811625    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.872873 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.872838    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.873106 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.873062    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p9f9\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-kube-api-access-4p9f9\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:45.939043 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:45.939015    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:46.375930 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:46.375908    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"]
Nov 04 06:06:46.377771 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:06:46.377745    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649c17e9_7aed_4729_b567_6e3fa8fb931c.slice/crio-9c5550fb3c6329f440480fd6e7d52a550963841a1ad85898ba56ed2937536975 WatchSource:0}: Error finding container 9c5550fb3c6329f440480fd6e7d52a550963841a1ad85898ba56ed2937536975: Status 404 returned error can't find the container with id 9c5550fb3c6329f440480fd6e7d52a550963841a1ad85898ba56ed2937536975
Nov 04 06:06:46.380151 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:46.380117    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:06:46.380216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:46.380186    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:06:46.380251 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:46.380215    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:06:46.465058 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:46.465013    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" event={"ID":"649c17e9-7aed-4729-b567-6e3fa8fb931c","Type":"ContainerStarted","Data":"bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d"}
Nov 04 06:06:46.465225 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:46.465094    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" event={"ID":"649c17e9-7aed-4729-b567-6e3fa8fb931c","Type":"ContainerStarted","Data":"9c5550fb3c6329f440480fd6e7d52a550963841a1ad85898ba56ed2937536975"}
Nov 04 06:06:46.592196 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:46.592140    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" podStartSLOduration=1.592121633 podStartE2EDuration="1.592121633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:06:46.589128669 +0000 UTC m=+1054.520326066" watchObservedRunningTime="2026-11-04 06:06:46.592121633 +0000 UTC m=+1054.523319029"
Nov 04 06:06:46.939700 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:46.939660    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:47.941265 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:47.941234    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 06:06:47.941640 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:47.941283    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 06:06:48.478845 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.478165    4497 generic.go:356] "Generic (PLEG): container finished" podID="40344774-ee6a-415c-b3f5-da522edcb596" containerID="3ba756c807e071949cadc52bde2d8db45b99daa64507c344e963cfaa5f79e674" exitCode=0
Nov 04 06:06:48.478845 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.478790    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" event={"ID":"40344774-ee6a-415c-b3f5-da522edcb596","Type":"ContainerDied","Data":"3ba756c807e071949cadc52bde2d8db45b99daa64507c344e963cfaa5f79e674"}
Nov 04 06:06:48.592663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.592638    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:06:48.642513 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642480    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/40344774-ee6a-415c-b3f5-da522edcb596-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40344774-ee6a-415c-b3f5-da522edcb596-istiod-ca-cert\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.642678 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642533    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-istio-token\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-istio-token\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.642678 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642574    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-certs\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.642748 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642680    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-socket\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.642787 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642748    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-envoy\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.642856 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642837    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-certs" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:06:48.642856 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642845    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/40344774-ee6a-415c-b3f5-da522edcb596-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40344774-ee6a-415c-b3f5-da522edcb596-istio-podinfo\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.642998 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642879    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-credential-socket\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.642998 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642914    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40344774-ee6a-415c-b3f5-da522edcb596-istiod-ca-cert" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:06:48.642998 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642933    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-socket" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:06:48.642998 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.642967    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-kube-api-access-7gmg6\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-kube-api-access-7gmg6\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.643194 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.643001    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-data\") pod \"40344774-ee6a-415c-b3f5-da522edcb596\" (UID: \"40344774-ee6a-415c-b3f5-da522edcb596\") "
Nov 04 06:06:48.643194 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.643121    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-credential-socket" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:06:48.643291 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.643271    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-data" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:06:48.643519 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.643497    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.643519 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.643524    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40344774-ee6a-415c-b3f5-da522edcb596-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.643835 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.643598    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.643835 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.643711    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.643835 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.643724    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.645187 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.645158    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-kube-api-access-7gmg6" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "kube-api-access-7gmg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:06:48.645282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.645185    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40344774-ee6a-415c-b3f5-da522edcb596-istio-podinfo" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:06:48.645282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.645252    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-envoy" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:06:48.645354 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.645277    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-istio-token" pod "40344774-ee6a-415c-b3f5-da522edcb596" (UID: "40344774-ee6a-415c-b3f5-da522edcb596"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:06:48.745228 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.745191    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gmg6\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-kube-api-access-7gmg6\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.745228 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.745223    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40344774-ee6a-415c-b3f5-da522edcb596-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.745228 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.745232    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40344774-ee6a-415c-b3f5-da522edcb596-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.745454 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.745240    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40344774-ee6a-415c-b3f5-da522edcb596-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:06:48.939542 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.939501    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 06:06:48.939728 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:48.939557    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 06:06:49.484571 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:49.484532    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285" event={"ID":"40344774-ee6a-415c-b3f5-da522edcb596","Type":"ContainerDied","Data":"a35f8c70f700bac804b30623af55c5ad523e562d2f94313322c309a43cc0c3ae"}
Nov 04 06:06:49.484571 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:49.484568    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"
Nov 04 06:06:49.485116 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:49.484597    4497 scope.go:122] "RemoveContainer" containerID="3ba756c807e071949cadc52bde2d8db45b99daa64507c344e963cfaa5f79e674"
Nov 04 06:06:49.671221 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:49.671189    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"]
Nov 04 06:06:49.726859 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:49.726819    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285"]
Nov 04 06:06:49.940038 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:49.940005    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 06:06:49.940222 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:49.940058    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 06:06:50.123964 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:50.123926    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:06:50.225931 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:50.225828    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40344774-ee6a-415c-b3f5-da522edcb596" path="/var/lib/kubelet/pods/40344774-ee6a-415c-b3f5-da522edcb596/volumes"
Nov 04 06:06:50.940007 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:50.939972    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 06:06:50.940390 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:50.940027    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 06:06:51.939402 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:51.939366    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 06:06:51.939580 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:51.939426    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 06:06:52.944403 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:52.944371    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:52.944879 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:52.944777    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:52.945345 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:52.945326    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:06:55.221964 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:06:55.221921    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:00.510501 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:00.510458    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:02.812949 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:02.812881    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:05.614653 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:05.614615    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:08.560132 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:08.560092    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:10.688690 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:10.688651    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:13.329312 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:07:13.329267    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:07:15.713274 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:15.713235    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:20.818277 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:20.818227    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:25.865919 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:25.865862    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:30.938450 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:30.938415    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:31.276321 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.276236    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:31.512529 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.512496    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7290-1e1f2a"]
Nov 04 06:07:31.512985 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.512970    4497 cpu_manager.go:414] "containerMap: removing container" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy"
Nov 04 06:07:31.513048 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.512986    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy"
Nov 04 06:07:31.513104 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.513067    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="40344774-ee6a-415c-b3f5-da522edcb596" containerName="istio-proxy"
Nov 04 06:07:31.516216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.516197    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-1e1f2a"
Nov 04 06:07:31.575511 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.575414    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-1e1f2a"]
Nov 04 06:07:31.623738 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.623701    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2cc4r\""
Nov 04 06:07:31.623738 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.623723    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 06:07:31.623738 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.623715    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 06:07:31.667798 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.667762    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nfhf\" (UniqueName: \"kubernetes.io/projected/b53a5865-013c-4e31-8740-85599bdb304a-kube-api-access-4nfhf\") pod \"test-curl-7290-1e1f2a\" (UID: \"b53a5865-013c-4e31-8740-85599bdb304a\") " pod="opendatahub/test-curl-7290-1e1f2a"
Nov 04 06:07:31.769371 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.769333    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfhf\" (UniqueName: \"kubernetes.io/projected/b53a5865-013c-4e31-8740-85599bdb304a-kube-api-access-4nfhf\") pod \"test-curl-7290-1e1f2a\" (UID: \"b53a5865-013c-4e31-8740-85599bdb304a\") " pod="opendatahub/test-curl-7290-1e1f2a"
Nov 04 06:07:31.832691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:31.832617    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nfhf\" (UniqueName: \"kubernetes.io/projected/b53a5865-013c-4e31-8740-85599bdb304a-kube-api-access-4nfhf\") pod \"test-curl-7290-1e1f2a\" (UID: \"b53a5865-013c-4e31-8740-85599bdb304a\") " pod="opendatahub/test-curl-7290-1e1f2a"
Nov 04 06:07:32.127682 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:32.127645    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-1e1f2a"
Nov 04 06:07:32.512085 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:32.511950    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7290-1e1f2a"]
Nov 04 06:07:32.514621 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:07:32.514594    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb53a5865_013c_4e31_8740_85599bdb304a.slice/crio-36f93dbe06c7a8d421de8dd8f8ea5979407506623f04cde183a71e90033563f0 WatchSource:0}: Error finding container 36f93dbe06c7a8d421de8dd8f8ea5979407506623f04cde183a71e90033563f0: Status 404 returned error can't find the container with id 36f93dbe06c7a8d421de8dd8f8ea5979407506623f04cde183a71e90033563f0
Nov 04 06:07:32.517690 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:32.517673    4497 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 06:07:32.741388 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:32.741351    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-1e1f2a" event={"ID":"b53a5865-013c-4e31-8740-85599bdb304a","Type":"ContainerStarted","Data":"36f93dbe06c7a8d421de8dd8f8ea5979407506623f04cde183a71e90033563f0"}
Nov 04 06:07:35.476712 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:35.476676    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:35.685135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:35.685099    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:35.760423 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:35.760322    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7290-1e1f2a" event={"ID":"b53a5865-013c-4e31-8740-85599bdb304a","Type":"ContainerStarted","Data":"f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5"}
Nov 04 06:07:35.890543 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:35.890471    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7290-1e1f2a" podStartSLOduration=2.434308121 podStartE2EDuration="4.890454829s" totalImagesPullingTime="2.456146708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:35.888996581 +0000 UTC m=+1103.820193991" watchObservedRunningTime="2026-11-04 06:07:35.890454829 +0000 UTC m=+1103.821652225"
Nov 04 06:07:35.955877 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:35.955841    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:36.103652 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:36.103615    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:36.316847 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:36.316812    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:37.417123 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:37.417090    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7290-1e1f2a"]
Nov 04 06:07:37.421567 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:37.421537    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7290-1e1f2a"]
Nov 04 06:07:37.632090 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:37.632048    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:37.769989 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:37.769880    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7290-1e1f2a" podUID="b53a5865-013c-4e31-8740-85599bdb304a" containerName="test-curl-7290-1e1f2a" containerID="cri-o://f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5" gracePeriod=2
Nov 04 06:07:37.823748 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:07:37.823710    4497 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7290-1e1f2a\" is forbidden: User \"system:node:ip-10-0-143-195.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-195.us-west-1.compute.internal' and this object" podUID="b53a5865-013c-4e31-8740-85599bdb304a" pod="opendatahub/test-curl-7290-1e1f2a"
Nov 04 06:07:40.006541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.006513    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-1e1f2a"
Nov 04 06:07:40.168840 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.168806    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b53a5865-013c-4e31-8740-85599bdb304a-kube-api-access-4nfhf\" (UniqueName: \"kubernetes.io/projected/b53a5865-013c-4e31-8740-85599bdb304a-kube-api-access-4nfhf\") pod \"b53a5865-013c-4e31-8740-85599bdb304a\" (UID: \"b53a5865-013c-4e31-8740-85599bdb304a\") "
Nov 04 06:07:40.171246 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.171211    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b53a5865-013c-4e31-8740-85599bdb304a-kube-api-access-4nfhf" pod "b53a5865-013c-4e31-8740-85599bdb304a" (UID: "b53a5865-013c-4e31-8740-85599bdb304a"). InnerVolumeSpecName "kube-api-access-4nfhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:07:40.213128 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.213091    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b53a5865-013c-4e31-8740-85599bdb304a" path="/var/lib/kubelet/pods/b53a5865-013c-4e31-8740-85599bdb304a/volumes"
Nov 04 06:07:40.227591 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.227558    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:40.270136 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.270096    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nfhf\" (UniqueName: \"kubernetes.io/projected/b53a5865-013c-4e31-8740-85599bdb304a-kube-api-access-4nfhf\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:40.786849 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.786809    4497 generic.go:356] "Generic (PLEG): container finished" podID="b53a5865-013c-4e31-8740-85599bdb304a" containerID="f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5" exitCode=137
Nov 04 06:07:40.787059 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.786854    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7290-1e1f2a"
Nov 04 06:07:40.787059 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.786912    4497 scope.go:122] "RemoveContainer" containerID="f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5"
Nov 04 06:07:40.796526 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.796506    4497 scope.go:122] "RemoveContainer" containerID="f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5"
Nov 04 06:07:40.796829 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:07:40.796809    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5\": container with ID starting with f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5 not found: ID does not exist" containerID="f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5"
Nov 04 06:07:40.796895 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.796838    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5"} err="failed to get container status \"f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5\": rpc error: code = NotFound desc = could not find container \"f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5\": container with ID starting with f1bd126565aaa3d747d0e4c7f3e8e10480d43657572de50edc34cb4c58ff75b5 not found: ID does not exist"
Nov 04 06:07:40.919693 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:40.919653    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"]
Nov 04 06:07:41.048412 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:41.048331    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:41.193098 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:41.193066    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:42.268674 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:42.268638    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:42.414973 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:42.414939    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:42.681137 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:42.681097    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"]
Nov 04 06:07:42.810533 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:42.810500    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:42.958080 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:42.957983    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:43.327028 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:07:43.326948    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:07:43.577694 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:43.577603    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:45.359354 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:45.359322    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:46.294673 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:46.294634    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:47.240021 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:47.239991    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:47.873898 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:47.873852    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"]
Nov 04 06:07:47.927984 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:47.927942    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"]
Nov 04 06:07:47.970068 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:47.970036    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:48.919398 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:48.919361    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:49.255372 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:49.255284    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:51.445040 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:51.445002    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:51.597249 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:51.597216    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:53.589867 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:53.589773    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:54.560501 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.560464    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"]
Nov 04 06:07:54.560992 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.560974    4497 cpu_manager.go:414] "containerMap: removing container" podUID="b53a5865-013c-4e31-8740-85599bdb304a" containerName="test-curl-7290-1e1f2a"
Nov 04 06:07:54.561096 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.560993    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b53a5865-013c-4e31-8740-85599bdb304a" containerName="test-curl-7290-1e1f2a"
Nov 04 06:07:54.561157 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.561111    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="b53a5865-013c-4e31-8740-85599bdb304a" containerName="test-curl-7290-1e1f2a"
Nov 04 06:07:54.565666 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.565644    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.624812 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.624780    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-dshm\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.625270 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.625095    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-home\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.625270 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.625136    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-model-cache\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.625348 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.625271    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nknd8\" (UniqueName: \"kubernetes.io/projected/66548d55-cc35-4fcf-9dce-38de6915747e-kube-api-access-nknd8\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.625399 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.625379    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-tmp-dir\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.625444 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.625416    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66548d55-cc35-4fcf-9dce-38de6915747e-tls-certs\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.649119 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.649085    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:54.674843 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.674818    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"distinct-w2-db31ef-kserve-self-signed-certs\""
Nov 04 06:07:54.676905 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.676875    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"]
Nov 04 06:07:54.727110 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727077    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nknd8\" (UniqueName: \"kubernetes.io/projected/66548d55-cc35-4fcf-9dce-38de6915747e-kube-api-access-nknd8\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.727317 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727166    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-tmp-dir\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.727317 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727197    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66548d55-cc35-4fcf-9dce-38de6915747e-tls-certs\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.727432 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727335    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-dshm\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.727432 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727395    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-home\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.727432 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727419    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-model-cache\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.727646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727623    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-tmp-dir\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.727765 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727746    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-home\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.727806 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.727771    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-model-cache\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.729593 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.729571    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-dshm\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.729881 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.729864    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66548d55-cc35-4fcf-9dce-38de6915747e-tls-certs\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.790189 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.790167    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nknd8\" (UniqueName: \"kubernetes.io/projected/66548d55-cc35-4fcf-9dce-38de6915747e-kube-api-access-nknd8\") pod \"distinct-w2-db31ef-kserve-5d987cf5d-659f8\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") " pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:54.877310 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:54.877276    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:55.262082 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:55.262055    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"]
Nov 04 06:07:55.264666 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:07:55.264636    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66548d55_cc35_4fcf_9dce_38de6915747e.slice/crio-c314c4671f5f2135166c3c7aa8370065f8960372e675f3182fa8bc7241caeedd WatchSource:0}: Error finding container c314c4671f5f2135166c3c7aa8370065f8960372e675f3182fa8bc7241caeedd: Status 404 returned error can't find the container with id c314c4671f5f2135166c3c7aa8370065f8960372e675f3182fa8bc7241caeedd
Nov 04 06:07:55.613172 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:55.613139    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:55.869083 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:55.869009    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8" event={"ID":"66548d55-cc35-4fcf-9dce-38de6915747e","Type":"ContainerStarted","Data":"ed6b8b1749627f46b49c24dc9e01514ffcedf110d40a4027c643d0dce9bb13ab"}
Nov 04 06:07:55.869083 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:55.869054    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8" event={"ID":"66548d55-cc35-4fcf-9dce-38de6915747e","Type":"ContainerStarted","Data":"c314c4671f5f2135166c3c7aa8370065f8960372e675f3182fa8bc7241caeedd"}
Nov 04 06:07:55.878356 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:55.878323    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:07:55.941108 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:55.941073    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp" podUID="a0b32921-0b5d-4955-ab47-0a3086d20557" containerName="main" containerID="cri-o://b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2" gracePeriod=45
Nov 04 06:07:55.949223 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:55.949193    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:55.990483 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:55.990425    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8" podStartSLOduration=1.990405465 podStartE2EDuration="1.990405465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:55.990198411 +0000 UTC m=+1123.921395808" watchObservedRunningTime="2026-11-04 06:07:55.990405465 +0000 UTC m=+1123.921602863"
Nov 04 06:07:56.205382 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.205350    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:07:56.356903 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.356845    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-tmp-dir\") pod \"a0b32921-0b5d-4955-ab47-0a3086d20557\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") "
Nov 04 06:07:56.357095 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.356924    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0b32921-0b5d-4955-ab47-0a3086d20557-kube-api-access-8ltq9\" (UniqueName: \"kubernetes.io/projected/a0b32921-0b5d-4955-ab47-0a3086d20557-kube-api-access-8ltq9\") pod \"a0b32921-0b5d-4955-ab47-0a3086d20557\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") "
Nov 04 06:07:56.357095 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357033    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-dshm\") pod \"a0b32921-0b5d-4955-ab47-0a3086d20557\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") "
Nov 04 06:07:56.357095 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357094    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a0b32921-0b5d-4955-ab47-0a3086d20557-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0b32921-0b5d-4955-ab47-0a3086d20557-tls-certs\") pod \"a0b32921-0b5d-4955-ab47-0a3086d20557\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") "
Nov 04 06:07:56.357317 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357134    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-model-cache\") pod \"a0b32921-0b5d-4955-ab47-0a3086d20557\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") "
Nov 04 06:07:56.357317 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357145    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-tmp-dir" pod "a0b32921-0b5d-4955-ab47-0a3086d20557" (UID: "a0b32921-0b5d-4955-ab47-0a3086d20557"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:07:56.357317 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357193    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-home\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-home\") pod \"a0b32921-0b5d-4955-ab47-0a3086d20557\" (UID: \"a0b32921-0b5d-4955-ab47-0a3086d20557\") "
Nov 04 06:07:56.357461 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357384    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-model-cache" pod "a0b32921-0b5d-4955-ab47-0a3086d20557" (UID: "a0b32921-0b5d-4955-ab47-0a3086d20557"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:07:56.357557 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357517    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-home" pod "a0b32921-0b5d-4955-ab47-0a3086d20557" (UID: "a0b32921-0b5d-4955-ab47-0a3086d20557"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:07:56.357679 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357661    4497 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-tmp-dir\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:56.357740 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357680    4497 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-model-cache\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:56.357740 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.357688    4497 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-home\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:56.360042 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.360011    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0b32921-0b5d-4955-ab47-0a3086d20557-kube-api-access-8ltq9" pod "a0b32921-0b5d-4955-ab47-0a3086d20557" (UID: "a0b32921-0b5d-4955-ab47-0a3086d20557"). InnerVolumeSpecName "kube-api-access-8ltq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:07:56.360156 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.360087    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0b32921-0b5d-4955-ab47-0a3086d20557-tls-certs" pod "a0b32921-0b5d-4955-ab47-0a3086d20557" (UID: "a0b32921-0b5d-4955-ab47-0a3086d20557"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:07:56.361010 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.360981    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-dshm" pod "a0b32921-0b5d-4955-ab47-0a3086d20557" (UID: "a0b32921-0b5d-4955-ab47-0a3086d20557"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:07:56.458977 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.458869    4497 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0b32921-0b5d-4955-ab47-0a3086d20557-dshm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:56.458977 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.458929    4497 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0b32921-0b5d-4955-ab47-0a3086d20557-tls-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:56.458977 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.458941    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ltq9\" (UniqueName: \"kubernetes.io/projected/a0b32921-0b5d-4955-ab47-0a3086d20557-kube-api-access-8ltq9\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:56.786403 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.786301    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:56.876178 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.876139    4497 generic.go:356] "Generic (PLEG): container finished" podID="a0b32921-0b5d-4955-ab47-0a3086d20557" containerID="b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2" exitCode=0
Nov 04 06:07:56.876644 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.876196    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"
Nov 04 06:07:56.876644 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.876262    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp" event={"ID":"a0b32921-0b5d-4955-ab47-0a3086d20557","Type":"ContainerDied","Data":"b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2"}
Nov 04 06:07:56.876644 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.876306    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp" event={"ID":"a0b32921-0b5d-4955-ab47-0a3086d20557","Type":"ContainerDied","Data":"fddb7ea48f3f84a921e422fad8e7388117ff9f63fb38866e91449b90514a60e5"}
Nov 04 06:07:56.876644 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.876323    4497 scope.go:122] "RemoveContainer" containerID="b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2"
Nov 04 06:07:56.886302 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.886283    4497 scope.go:122] "RemoveContainer" containerID="b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2"
Nov 04 06:07:56.886587 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:07:56.886569    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2\": container with ID starting with b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2 not found: ID does not exist" containerID="b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2"
Nov 04 06:07:56.886671 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:56.886594    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2"} err="failed to get container status \"b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2\": rpc error: code = NotFound desc = could not find container \"b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2\": container with ID starting with b0244b14c4a08451124d140ec8c872803361664aabc49fcebc2816c1122057c2 not found: ID does not exist"
Nov 04 06:07:57.046616 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.046536    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"]
Nov 04 06:07:57.098795 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.098766    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp"]
Nov 04 06:07:57.117458 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.117423    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:57.171845 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.171740    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-32f7d6/premium-w3-32f7d6-kserve-64cc8496ff-drhdp" podUID="a0b32921-0b5d-4955-ab47-0a3086d20557" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 04 06:07:57.260990 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.260951    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:57.701093 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.701059    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg" podUID="fb3b3a38-7ac6-4626-aa33-712b8c95bc26" containerName="main" containerID="cri-o://02113c3ed2a8bb7755c314373b2300a79f7ea721d8ae704e6538299255f7d518" gracePeriod=45
Nov 04 06:07:57.791192 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.791149    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg" podUID="fb3b3a38-7ac6-4626-aa33-712b8c95bc26" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": dial tcp 10.133.0.50:8000: connect: connection refused"
Nov 04 06:07:57.887101 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.887067    4497 generic.go:356] "Generic (PLEG): container finished" podID="fb3b3a38-7ac6-4626-aa33-712b8c95bc26" containerID="02113c3ed2a8bb7755c314373b2300a79f7ea721d8ae704e6538299255f7d518" exitCode=0
Nov 04 06:07:57.887459 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.887146    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg" event={"ID":"fb3b3a38-7ac6-4626-aa33-712b8c95bc26","Type":"ContainerDied","Data":"02113c3ed2a8bb7755c314373b2300a79f7ea721d8ae704e6538299255f7d518"}
Nov 04 06:07:57.964680 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:57.964619    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:07:58.078994 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.078954    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-model-cache\") pod \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") "
Nov 04 06:07:58.079220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079079    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-dshm\") pod \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") "
Nov 04 06:07:58.079220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079195    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tls-certs\") pod \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") "
Nov 04 06:07:58.079343 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079229    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-home\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-home\") pod \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") "
Nov 04 06:07:58.079343 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079264    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tmp-dir\") pod \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") "
Nov 04 06:07:58.079343 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079280    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-model-cache" pod "fb3b3a38-7ac6-4626-aa33-712b8c95bc26" (UID: "fb3b3a38-7ac6-4626-aa33-712b8c95bc26"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:07:58.079343 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079324    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-kube-api-access-xtrl2\" (UniqueName: \"kubernetes.io/projected/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-kube-api-access-xtrl2\") pod \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\" (UID: \"fb3b3a38-7ac6-4626-aa33-712b8c95bc26\") "
Nov 04 06:07:58.079555 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079501    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-home" pod "fb3b3a38-7ac6-4626-aa33-712b8c95bc26" (UID: "fb3b3a38-7ac6-4626-aa33-712b8c95bc26"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:07:58.079555 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079516    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tmp-dir" pod "fb3b3a38-7ac6-4626-aa33-712b8c95bc26" (UID: "fb3b3a38-7ac6-4626-aa33-712b8c95bc26"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:07:58.079826 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079799    4497 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-model-cache\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:58.079826 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079827    4497 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-home\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:58.080171 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.079842    4497 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tmp-dir\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:58.081747 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.081720    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tls-certs" pod "fb3b3a38-7ac6-4626-aa33-712b8c95bc26" (UID: "fb3b3a38-7ac6-4626-aa33-712b8c95bc26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:07:58.081747 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.081748    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-dshm" pod "fb3b3a38-7ac6-4626-aa33-712b8c95bc26" (UID: "fb3b3a38-7ac6-4626-aa33-712b8c95bc26"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:07:58.081747 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.081909    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-kube-api-access-xtrl2" pod "fb3b3a38-7ac6-4626-aa33-712b8c95bc26" (UID: "fb3b3a38-7ac6-4626-aa33-712b8c95bc26"). InnerVolumeSpecName "kube-api-access-xtrl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:07:58.180652 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.180606    4497 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-dshm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:58.180652 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.180650    4497 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-tls-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:58.180652 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.180663    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtrl2\" (UniqueName: \"kubernetes.io/projected/fb3b3a38-7ac6-4626-aa33-712b8c95bc26-kube-api-access-xtrl2\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:07:58.213049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.213016    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0b32921-0b5d-4955-ab47-0a3086d20557" path="/var/lib/kubelet/pods/a0b32921-0b5d-4955-ab47-0a3086d20557/volumes"
Nov 04 06:07:58.349874 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.348372    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:07:58.893457 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.893427    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"
Nov 04 06:07:58.893965 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.893455    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg" event={"ID":"fb3b3a38-7ac6-4626-aa33-712b8c95bc26","Type":"ContainerDied","Data":"459813f140d345b5b9338d8011e67d42ff7fb9f67dd78761e77f63d8acc8e9a9"}
Nov 04 06:07:58.893965 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:58.893511    4497 scope.go:122] "RemoveContainer" containerID="02113c3ed2a8bb7755c314373b2300a79f7ea721d8ae704e6538299255f7d518"
Nov 04 06:07:59.064195 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:59.064156    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"]
Nov 04 06:07:59.116479 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:59.116441    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/simulator-w6-18990c-kserve-5bf4457787-kk2tg"]
Nov 04 06:07:59.293245 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:07:59.293163    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:00.050528 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:00.050493    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:00.201050 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:00.201013    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:00.212602 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:00.212554    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb3b3a38-7ac6-4626-aa33-712b8c95bc26" path="/var/lib/kubelet/pods/fb3b3a38-7ac6-4626-aa33-712b8c95bc26/volumes"
Nov 04 06:08:01.816432 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:01.816396    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:02.081052 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:02.080964    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:02.391847 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:02.391812    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:02.399406 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:02.399373    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"]
Nov 04 06:08:02.799684 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:02.799588    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:02.894138 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:02.894093    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd" podUID="5c51d5a2-2962-410b-aab4-c97674ac344f" containerName="main" containerID="cri-o://fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29" gracePeriod=45
Nov 04 06:08:02.947450 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:02.947400    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:02.950282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:02.950253    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk" podUID="bc2e580f-51db-4076-93c3-6240feef04d8" containerName="main" containerID="cri-o://ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea" gracePeriod=45
Nov 04 06:08:03.210123 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.210097    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:08:03.241373 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.241346    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:08:03.337482 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337447    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-tmp-dir\") pod \"bc2e580f-51db-4076-93c3-6240feef04d8\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") "
Nov 04 06:08:03.337645 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337504    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-dshm\") pod \"bc2e580f-51db-4076-93c3-6240feef04d8\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") "
Nov 04 06:08:03.337645 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337527    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-model-cache\") pod \"5c51d5a2-2962-410b-aab4-c97674ac344f\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") "
Nov 04 06:08:03.337645 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337562    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc2e580f-51db-4076-93c3-6240feef04d8-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc2e580f-51db-4076-93c3-6240feef04d8-tls-certs\") pod \"bc2e580f-51db-4076-93c3-6240feef04d8\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") "
Nov 04 06:08:03.337645 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337608    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-model-cache\") pod \"bc2e580f-51db-4076-93c3-6240feef04d8\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") "
Nov 04 06:08:03.337820 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337666    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc2e580f-51db-4076-93c3-6240feef04d8-kube-api-access-dl5x4\" (UniqueName: \"kubernetes.io/projected/bc2e580f-51db-4076-93c3-6240feef04d8-kube-api-access-dl5x4\") pod \"bc2e580f-51db-4076-93c3-6240feef04d8\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") "
Nov 04 06:08:03.337820 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337684    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-home\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-home\") pod \"bc2e580f-51db-4076-93c3-6240feef04d8\" (UID: \"bc2e580f-51db-4076-93c3-6240feef04d8\") "
Nov 04 06:08:03.337820 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337725    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-dshm\") pod \"5c51d5a2-2962-410b-aab4-c97674ac344f\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") "
Nov 04 06:08:03.337820 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337764    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-home\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-home\") pod \"5c51d5a2-2962-410b-aab4-c97674ac344f\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") "
Nov 04 06:08:03.337820 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337797    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c51d5a2-2962-410b-aab4-c97674ac344f-kube-api-access-zlc4h\" (UniqueName: \"kubernetes.io/projected/5c51d5a2-2962-410b-aab4-c97674ac344f-kube-api-access-zlc4h\") pod \"5c51d5a2-2962-410b-aab4-c97674ac344f\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") "
Nov 04 06:08:03.338090 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337830    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c51d5a2-2962-410b-aab4-c97674ac344f-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c51d5a2-2962-410b-aab4-c97674ac344f-tls-certs\") pod \"5c51d5a2-2962-410b-aab4-c97674ac344f\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") "
Nov 04 06:08:03.338090 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.337858    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-tmp-dir\") pod \"5c51d5a2-2962-410b-aab4-c97674ac344f\" (UID: \"5c51d5a2-2962-410b-aab4-c97674ac344f\") "
Nov 04 06:08:03.339683 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.338503    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-tmp-dir" pod "bc2e580f-51db-4076-93c3-6240feef04d8" (UID: "bc2e580f-51db-4076-93c3-6240feef04d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:03.339683 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.338696    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-home" pod "bc2e580f-51db-4076-93c3-6240feef04d8" (UID: "bc2e580f-51db-4076-93c3-6240feef04d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:03.339683 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.339044    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-home" pod "5c51d5a2-2962-410b-aab4-c97674ac344f" (UID: "5c51d5a2-2962-410b-aab4-c97674ac344f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:03.339683 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.339556    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-model-cache" pod "5c51d5a2-2962-410b-aab4-c97674ac344f" (UID: "5c51d5a2-2962-410b-aab4-c97674ac344f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:03.339683 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.339613    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-tmp-dir" pod "5c51d5a2-2962-410b-aab4-c97674ac344f" (UID: "5c51d5a2-2962-410b-aab4-c97674ac344f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:03.339683 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.339659    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-model-cache" pod "bc2e580f-51db-4076-93c3-6240feef04d8" (UID: "bc2e580f-51db-4076-93c3-6240feef04d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:03.340717 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.340692    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc2e580f-51db-4076-93c3-6240feef04d8-kube-api-access-dl5x4" pod "bc2e580f-51db-4076-93c3-6240feef04d8" (UID: "bc2e580f-51db-4076-93c3-6240feef04d8"). InnerVolumeSpecName "kube-api-access-dl5x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:03.340958 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.340930    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-dshm" pod "bc2e580f-51db-4076-93c3-6240feef04d8" (UID: "bc2e580f-51db-4076-93c3-6240feef04d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:03.342144 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.342102    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c51d5a2-2962-410b-aab4-c97674ac344f-kube-api-access-zlc4h" pod "5c51d5a2-2962-410b-aab4-c97674ac344f" (UID: "5c51d5a2-2962-410b-aab4-c97674ac344f"). InnerVolumeSpecName "kube-api-access-zlc4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:03.342245 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.342155    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-dshm" pod "5c51d5a2-2962-410b-aab4-c97674ac344f" (UID: "5c51d5a2-2962-410b-aab4-c97674ac344f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:03.342645 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.342618    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c51d5a2-2962-410b-aab4-c97674ac344f-tls-certs" pod "5c51d5a2-2962-410b-aab4-c97674ac344f" (UID: "5c51d5a2-2962-410b-aab4-c97674ac344f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:08:03.343021 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.342994    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc2e580f-51db-4076-93c3-6240feef04d8-tls-certs" pod "bc2e580f-51db-4076-93c3-6240feef04d8" (UID: "bc2e580f-51db-4076-93c3-6240feef04d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:08:03.439473 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439434    4497 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-model-cache\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439473 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439467    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl5x4\" (UniqueName: \"kubernetes.io/projected/bc2e580f-51db-4076-93c3-6240feef04d8-kube-api-access-dl5x4\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439473 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439477    4497 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-home\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439486    4497 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-dshm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439495    4497 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-home\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439503    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlc4h\" (UniqueName: \"kubernetes.io/projected/5c51d5a2-2962-410b-aab4-c97674ac344f-kube-api-access-zlc4h\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439511    4497 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c51d5a2-2962-410b-aab4-c97674ac344f-tls-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439520    4497 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-tmp-dir\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439529    4497 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-tmp-dir\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439536    4497 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc2e580f-51db-4076-93c3-6240feef04d8-dshm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439544    4497 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c51d5a2-2962-410b-aab4-c97674ac344f-model-cache\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.439723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.439552    4497 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc2e580f-51db-4076-93c3-6240feef04d8-tls-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:03.921031 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.920994    4497 generic.go:356] "Generic (PLEG): container finished" podID="5c51d5a2-2962-410b-aab4-c97674ac344f" containerID="fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29" exitCode=0
Nov 04 06:08:03.921469 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.921044    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"
Nov 04 06:08:03.921469 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.921081    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd" event={"ID":"5c51d5a2-2962-410b-aab4-c97674ac344f","Type":"ContainerDied","Data":"fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29"}
Nov 04 06:08:03.921469 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.921138    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd" event={"ID":"5c51d5a2-2962-410b-aab4-c97674ac344f","Type":"ContainerDied","Data":"a4020de188f2cfe6b7dd208553e176e8741045000bb2a4678d97b3b691cf84f9"}
Nov 04 06:08:03.921469 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.921162    4497 scope.go:122] "RemoveContainer" containerID="fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29"
Nov 04 06:08:03.922624 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.922417    4497 generic.go:356] "Generic (PLEG): container finished" podID="bc2e580f-51db-4076-93c3-6240feef04d8" containerID="ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea" exitCode=0
Nov 04 06:08:03.922624 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.922445    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk" event={"ID":"bc2e580f-51db-4076-93c3-6240feef04d8","Type":"ContainerDied","Data":"ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea"}
Nov 04 06:08:03.922624 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.922471    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"
Nov 04 06:08:03.922624 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.922485    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk" event={"ID":"bc2e580f-51db-4076-93c3-6240feef04d8","Type":"ContainerDied","Data":"7a89e68ffd29bff4be4631898d0fc43a2143753dbfd755d8a738722a00e8447a"}
Nov 04 06:08:03.931580 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.931558    4497 scope.go:122] "RemoveContainer" containerID="fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29"
Nov 04 06:08:03.931985 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:03.931962    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29\": container with ID starting with fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29 not found: ID does not exist" containerID="fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29"
Nov 04 06:08:03.932047 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.931995    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29"} err="failed to get container status \"fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29\": rpc error: code = NotFound desc = could not find container \"fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29\": container with ID starting with fe04a2c497e03ac66f3539ef354e531f1d8b18995dcf74dc8f175a29777aad29 not found: ID does not exist"
Nov 04 06:08:03.932047 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.932015    4497 scope.go:122] "RemoveContainer" containerID="ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea"
Nov 04 06:08:03.950150 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.950099    4497 scope.go:122] "RemoveContainer" containerID="ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea"
Nov 04 06:08:03.950654 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:03.950619    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea\": container with ID starting with ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea not found: ID does not exist" containerID="ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea"
Nov 04 06:08:03.950754 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:03.950679    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea"} err="failed to get container status \"ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea\": rpc error: code = NotFound desc = could not find container \"ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea\": container with ID starting with ab74b7afca5c5029be392eb96e9f1965d64637e27bd14404b4f4766591abc0ea not found: ID does not exist"
Nov 04 06:08:04.093599 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.093564    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"]
Nov 04 06:08:04.099581 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.099551    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-356418/premium-w1-356418-kserve-69887bc856-vt9zd"]
Nov 04 06:08:04.213770 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.213669    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c51d5a2-2962-410b-aab4-c97674ac344f" path="/var/lib/kubelet/pods/5c51d5a2-2962-410b-aab4-c97674ac344f/volumes"
Nov 04 06:08:04.214091 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.214071    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"]
Nov 04 06:08:04.217645 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.217619    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-356418/simulator-w1-356418-kserve-6c488c44f-6chlk"]
Nov 04 06:08:04.627181 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.627142    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:04.887982 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.885259    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:08:04.904068 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.904035    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:08:04.941620 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:04.941586    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:08:05.450646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:05.450592    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:05.597547 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:05.597507    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:05.747618 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:05.747483    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:06.218913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:06.218770    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc2e580f-51db-4076-93c3-6240feef04d8" path="/var/lib/kubelet/pods/bc2e580f-51db-4076-93c3-6240feef04d8/volumes"
Nov 04 06:08:07.400523 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:07.400478    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg" podUID="c1515409-9b5e-48f5-8eda-5a1075d1135f" containerName="payload-processing" containerID="cri-o://1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d" gracePeriod=25
Nov 04 06:08:07.514528 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:07.514485    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:08.199194 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:08.199157    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg" podUID="c1515409-9b5e-48f5-8eda-5a1075d1135f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 06:08:08.229192 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:08.229154    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:08.706855 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:08.706816    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:08.938469 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:08.938428    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:10.504075 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:10.504039    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:12.603332 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:12.603232    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:13.327434 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:13.327394    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:08:14.841905 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:14.841850    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:17.084483 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.084439    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"]
Nov 04 06:08:17.084989 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.084700    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn" podUID="cf953974-421f-4bf7-97d9-6e0c738f1b42" containerName="maas-api" containerID="cri-o://fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431" gracePeriod=30
Nov 04 06:08:17.180418 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.180381    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:17.347031 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.347006    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:08:17.408600 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.408568    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-metrics-certs\") pod \"cf953974-421f-4bf7-97d9-6e0c738f1b42\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") "
Nov 04 06:08:17.408806 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.408639    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf953974-421f-4bf7-97d9-6e0c738f1b42-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf953974-421f-4bf7-97d9-6e0c738f1b42-openshift-service-ca\") pod \"cf953974-421f-4bf7-97d9-6e0c738f1b42\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") "
Nov 04 06:08:17.408806 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.408670    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf953974-421f-4bf7-97d9-6e0c738f1b42-kube-api-access-fb4nw\" (UniqueName: \"kubernetes.io/projected/cf953974-421f-4bf7-97d9-6e0c738f1b42-kube-api-access-fb4nw\") pod \"cf953974-421f-4bf7-97d9-6e0c738f1b42\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") "
Nov 04 06:08:17.408806 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.408784    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls\") pod \"cf953974-421f-4bf7-97d9-6e0c738f1b42\" (UID: \"cf953974-421f-4bf7-97d9-6e0c738f1b42\") "
Nov 04 06:08:17.409027 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.409002    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf953974-421f-4bf7-97d9-6e0c738f1b42-openshift-service-ca" pod "cf953974-421f-4bf7-97d9-6e0c738f1b42" (UID: "cf953974-421f-4bf7-97d9-6e0c738f1b42"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:08:17.409210 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.409192    4497 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf953974-421f-4bf7-97d9-6e0c738f1b42-openshift-service-ca\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:17.410979 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.410952    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf953974-421f-4bf7-97d9-6e0c738f1b42-kube-api-access-fb4nw" pod "cf953974-421f-4bf7-97d9-6e0c738f1b42" (UID: "cf953974-421f-4bf7-97d9-6e0c738f1b42"). InnerVolumeSpecName "kube-api-access-fb4nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:17.411090 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.411053    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls" pod "cf953974-421f-4bf7-97d9-6e0c738f1b42" (UID: "cf953974-421f-4bf7-97d9-6e0c738f1b42"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:08:17.411137 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.411103    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-metrics-certs" pod "cf953974-421f-4bf7-97d9-6e0c738f1b42" (UID: "cf953974-421f-4bf7-97d9-6e0c738f1b42"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:08:17.511405 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.511196    4497 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-metrics-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:17.511405 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.511249    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb4nw\" (UniqueName: \"kubernetes.io/projected/cf953974-421f-4bf7-97d9-6e0c738f1b42-kube-api-access-fb4nw\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:17.511405 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:17.511267    4497 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf953974-421f-4bf7-97d9-6e0c738f1b42-maas-api-tls\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:18.014334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.014291    4497 generic.go:356] "Generic (PLEG): container finished" podID="cf953974-421f-4bf7-97d9-6e0c738f1b42" containerID="fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431" exitCode=0
Nov 04 06:08:18.014519 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.014351    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"
Nov 04 06:08:18.014519 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.014377    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn" event={"ID":"cf953974-421f-4bf7-97d9-6e0c738f1b42","Type":"ContainerDied","Data":"fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431"}
Nov 04 06:08:18.014519 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.014463    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn" event={"ID":"cf953974-421f-4bf7-97d9-6e0c738f1b42","Type":"ContainerDied","Data":"9c3c8a440cee9d761dc20fce5ba684eba1cd94ba799e6866839e9743bc90a237"}
Nov 04 06:08:18.014519 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.014490    4497 scope.go:122] "RemoveContainer" containerID="fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431"
Nov 04 06:08:18.024272 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.024247    4497 scope.go:122] "RemoveContainer" containerID="fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431"
Nov 04 06:08:18.024622 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:18.024600    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431\": container with ID starting with fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431 not found: ID does not exist" containerID="fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431"
Nov 04 06:08:18.024672 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.024634    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431"} err="failed to get container status \"fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431\": rpc error: code = NotFound desc = could not find container \"fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431\": container with ID starting with fd8ff9a867ebd633f433736b5f8b32ac1aab6b73a8935381c86d4dcd98975431 not found: ID does not exist"
Nov 04 06:08:18.192922 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.189131    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"]
Nov 04 06:08:18.199479 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.199439    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg" podUID="c1515409-9b5e-48f5-8eda-5a1075d1135f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 06:08:18.224746 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.224719    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:18.233958 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.233919    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-32f7d6-54b45b87b8-n7qvn"]
Nov 04 06:08:18.368931 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.368880    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:18.513970 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:18.513937    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:19.041739 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:19.041703    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:19.624096 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:19.624057    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:20.213650 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:20.213615    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf953974-421f-4bf7-97d9-6e0c738f1b42" path="/var/lib/kubelet/pods/cf953974-421f-4bf7-97d9-6e0c738f1b42/volumes"
Nov 04 06:08:20.683831 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:20.683798    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:20.833748 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:20.833715    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:20.993984 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:20.993809    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:21.147321 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:21.147276    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:21.416098 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:21.416067    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:21.566185 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:21.566149    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:21.714613 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:21.714513    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:22.475915 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:22.475858    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:22.931048 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:22.931015    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:23.032469 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:23.032426    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"]
Nov 04 06:08:23.032703 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:23.032680    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy" containerID="cri-o://a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c" gracePeriod=30
Nov 04 06:08:23.076026 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:23.075985    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:23.462558 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:23.462522    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:24.105774 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.105732    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:24.308014 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.307981    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:24.566250 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.566152    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:24.712687 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.712656    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:24.939448 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.939413    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"]
Nov 04 06:08:24.940039 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940024    4497 cpu_manager.go:414] "containerMap: removing container" podUID="5c51d5a2-2962-410b-aab4-c97674ac344f" containerName="main"
Nov 04 06:08:24.940135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940042    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c51d5a2-2962-410b-aab4-c97674ac344f" containerName="main"
Nov 04 06:08:24.940135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940068    4497 cpu_manager.go:414] "containerMap: removing container" podUID="cf953974-421f-4bf7-97d9-6e0c738f1b42" containerName="maas-api"
Nov 04 06:08:24.940135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940076    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf953974-421f-4bf7-97d9-6e0c738f1b42" containerName="maas-api"
Nov 04 06:08:24.940135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940092    4497 cpu_manager.go:414] "containerMap: removing container" podUID="a0b32921-0b5d-4955-ab47-0a3086d20557" containerName="main"
Nov 04 06:08:24.940135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940099    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0b32921-0b5d-4955-ab47-0a3086d20557" containerName="main"
Nov 04 06:08:24.940135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940114    4497 cpu_manager.go:414] "containerMap: removing container" podUID="bc2e580f-51db-4076-93c3-6240feef04d8" containerName="main"
Nov 04 06:08:24.940135 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940122    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc2e580f-51db-4076-93c3-6240feef04d8" containerName="main"
Nov 04 06:08:24.940341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940142    4497 cpu_manager.go:414] "containerMap: removing container" podUID="fb3b3a38-7ac6-4626-aa33-712b8c95bc26" containerName="main"
Nov 04 06:08:24.940341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940150    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb3b3a38-7ac6-4626-aa33-712b8c95bc26" containerName="main"
Nov 04 06:08:24.940341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940240    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc2e580f-51db-4076-93c3-6240feef04d8" containerName="main"
Nov 04 06:08:24.940341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940252    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb3b3a38-7ac6-4626-aa33-712b8c95bc26" containerName="main"
Nov 04 06:08:24.940341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940264    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c51d5a2-2962-410b-aab4-c97674ac344f" containerName="main"
Nov 04 06:08:24.940341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940274    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf953974-421f-4bf7-97d9-6e0c738f1b42" containerName="maas-api"
Nov 04 06:08:24.940341 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.940283    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0b32921-0b5d-4955-ab47-0a3086d20557" containerName="main"
Nov 04 06:08:24.943769 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.943750    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:24.995853 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.995822    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bf11679-e8d8-438d-be95-b687f4974b0e-tls-certs\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:24.996032 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.995876    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-tmp-dir\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:24.996032 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.995996    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-home\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:24.996110 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.996045    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-dshm\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:24.996110 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.996072    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfhsw\" (UniqueName: \"kubernetes.io/projected/1bf11679-e8d8-438d-be95-b687f4974b0e-kube-api-access-tfhsw\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:24.996110 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:24.996105    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-model-cache\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.038999 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.038961    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:25.051297 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.051212    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"kube-root-ca.crt\""
Nov 04 06:08:25.051297 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.051208    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"default-dockercfg-xtn25\""
Nov 04 06:08:25.051297 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.051244    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"distinct-2-w4-856c68-kserve-self-signed-certs\""
Nov 04 06:08:25.051297 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.051263    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"openshift-service-ca.crt\""
Nov 04 06:08:25.053424 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.053400    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"]
Nov 04 06:08:25.097778 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.097739    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-home\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.098009 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.097789    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-dshm\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.098009 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.097820    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhsw\" (UniqueName: \"kubernetes.io/projected/1bf11679-e8d8-438d-be95-b687f4974b0e-kube-api-access-tfhsw\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.098009 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.097860    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-model-cache\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.098009 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.097996    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bf11679-e8d8-438d-be95-b687f4974b0e-tls-certs\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.098227 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.098037    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-tmp-dir\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.098313 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.098276    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-home\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.098377 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.098316    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-model-cache\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.098418 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.098385    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-tmp-dir\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.100272 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.100254    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-dshm\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.100610 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.100593    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bf11679-e8d8-438d-be95-b687f4974b0e-tls-certs\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.161403 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.161364    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfhsw\" (UniqueName: \"kubernetes.io/projected/1bf11679-e8d8-438d-be95-b687f4974b0e-kube-api-access-tfhsw\") pod \"distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") " pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.255848 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.255755    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:25.642931 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.642901    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"]
Nov 04 06:08:25.645597 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:08:25.645566    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bf11679_e8d8_438d_be95_b687f4974b0e.slice/crio-46145aee2c4e0de45a9d72863e08598177422e133417730434c0e47fbb4a33df WatchSource:0}: Error finding container 46145aee2c4e0de45a9d72863e08598177422e133417730434c0e47fbb4a33df: Status 404 returned error can't find the container with id 46145aee2c4e0de45a9d72863e08598177422e133417730434c0e47fbb4a33df
Nov 04 06:08:25.698472 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:25.698443    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:26.059304 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:26.059208    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n" event={"ID":"1bf11679-e8d8-438d-be95-b687f4974b0e","Type":"ContainerStarted","Data":"b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f"}
Nov 04 06:08:26.059304 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:26.059248    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n" event={"ID":"1bf11679-e8d8-438d-be95-b687f4974b0e","Type":"ContainerStarted","Data":"46145aee2c4e0de45a9d72863e08598177422e133417730434c0e47fbb4a33df"}
Nov 04 06:08:26.085062 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:26.085029    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:26.180841 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:26.180781    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n" podStartSLOduration=2.18076202 podStartE2EDuration="2.18076202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:08:26.179877775 +0000 UTC m=+1154.111075171" watchObservedRunningTime="2026-11-04 06:08:26.18076202 +0000 UTC m=+1154.111959418"
Nov 04 06:08:26.230369 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:26.230336    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:26.255931 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:26.255874    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:26.385362 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:26.385321    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:27.221575 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.221536    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:27.422203 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.422176    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:27.666661 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.666633    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:08:27.726286 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.726253    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c1515409-9b5e-48f5-8eda-5a1075d1135f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1515409-9b5e-48f5-8eda-5a1075d1135f-plugins-config-volume\") pod \"c1515409-9b5e-48f5-8eda-5a1075d1135f\" (UID: \"c1515409-9b5e-48f5-8eda-5a1075d1135f\") "
Nov 04 06:08:27.726468 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.726329    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1515409-9b5e-48f5-8eda-5a1075d1135f-kube-api-access-79w6r\" (UniqueName: \"kubernetes.io/projected/c1515409-9b5e-48f5-8eda-5a1075d1135f-kube-api-access-79w6r\") pod \"c1515409-9b5e-48f5-8eda-5a1075d1135f\" (UID: \"c1515409-9b5e-48f5-8eda-5a1075d1135f\") "
Nov 04 06:08:27.726634 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.726600    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1515409-9b5e-48f5-8eda-5a1075d1135f-plugins-config-volume" pod "c1515409-9b5e-48f5-8eda-5a1075d1135f" (UID: "c1515409-9b5e-48f5-8eda-5a1075d1135f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:08:27.728510 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.728494    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1515409-9b5e-48f5-8eda-5a1075d1135f-kube-api-access-79w6r" pod "c1515409-9b5e-48f5-8eda-5a1075d1135f" (UID: "c1515409-9b5e-48f5-8eda-5a1075d1135f"). InnerVolumeSpecName "kube-api-access-79w6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:27.827974 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.827824    4497 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1515409-9b5e-48f5-8eda-5a1075d1135f-plugins-config-volume\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:27.827974 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:27.827863    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79w6r\" (UniqueName: \"kubernetes.io/projected/c1515409-9b5e-48f5-8eda-5a1075d1135f-kube-api-access-79w6r\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.070790 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.070760    4497 generic.go:356] "Generic (PLEG): container finished" podID="c1515409-9b5e-48f5-8eda-5a1075d1135f" containerID="1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d" exitCode=0
Nov 04 06:08:28.070976 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.070803    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"
Nov 04 06:08:28.070976 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.070845    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg" event={"ID":"c1515409-9b5e-48f5-8eda-5a1075d1135f","Type":"ContainerDied","Data":"1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d"}
Nov 04 06:08:28.070976 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.070945    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg" event={"ID":"c1515409-9b5e-48f5-8eda-5a1075d1135f","Type":"ContainerDied","Data":"f12d2fbf920ffd7ce59686b2568ed41a917dbbc240fd45903d0e1b445e7e9437"}
Nov 04 06:08:28.070976 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.070972    4497 scope.go:122] "RemoveContainer" containerID="1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d"
Nov 04 06:08:28.144208 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.144186    4497 scope.go:122] "RemoveContainer" containerID="1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d"
Nov 04 06:08:28.144567 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:28.144547    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d\": container with ID starting with 1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d not found: ID does not exist" containerID="1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d"
Nov 04 06:08:28.144643 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.144581    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d"} err="failed to get container status \"1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d\": rpc error: code = NotFound desc = could not find container \"1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d\": container with ID starting with 1b5bfca6f6eb4eacf6d73282f70d11f9c34350f7ca8282cffe1cb7c19867437d not found: ID does not exist"
Nov 04 06:08:28.248764 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.248726    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"]
Nov 04 06:08:28.255896 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.255852    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg"]
Nov 04 06:08:28.282468 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.282439    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:08:28.331826 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.331785    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-envoy\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.331846    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-socket\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.331957    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-token\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-token\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332005    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-kube-api-access-2rllm\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-kube-api-access-2rllm\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332066 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332061    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-credential-socket\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332117    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-data\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332152    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-certs\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332178    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-socket" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:28.332282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332205    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istiod-ca-cert\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332282 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332262    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-podinfo\") pod \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\" (UID: \"f225a8f6-5390-429f-9dbc-d2cd97e7303c\") "
Nov 04 06:08:28.332811 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332454    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-credential-socket" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:28.332811 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332481    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-certs" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:28.332811 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332470    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-data" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:28.332811 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.332621    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istiod-ca-cert" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:08:28.333139 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.333114    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.333139 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.333137    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.333139 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.333147    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.333387 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.333157    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.333387 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.333164    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.334286 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.334268    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-kube-api-access-2rllm" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "kube-api-access-2rllm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:28.334367 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.334339    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-envoy" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:28.334813 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.334799    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-token" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:28.334907 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.334878    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-podinfo" pod "f225a8f6-5390-429f-9dbc-d2cd97e7303c" (UID: "f225a8f6-5390-429f-9dbc-d2cd97e7303c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:08:28.434388 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.434357    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.434388 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.434385    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.434388 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.434395    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:28.434665 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:28.434404    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rllm\" (UniqueName: \"kubernetes.io/projected/f225a8f6-5390-429f-9dbc-d2cd97e7303c-kube-api-access-2rllm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:29.078748 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.078714    4497 generic.go:356] "Generic (PLEG): container finished" podID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerID="a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c" exitCode=0
Nov 04 06:08:29.078940 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.078767    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"
Nov 04 06:08:29.078940 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.078774    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" event={"ID":"f225a8f6-5390-429f-9dbc-d2cd97e7303c","Type":"ContainerDied","Data":"a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c"}
Nov 04 06:08:29.078940 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.078820    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p" event={"ID":"f225a8f6-5390-429f-9dbc-d2cd97e7303c","Type":"ContainerDied","Data":"5a522c403ab39c4b492b480cc4283eefb25615c9269884a91b1bb3b995d32668"}
Nov 04 06:08:29.078940 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.078845    4497 scope.go:122] "RemoveContainer" containerID="a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c"
Nov 04 06:08:29.087901 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.087862    4497 scope.go:122] "RemoveContainer" containerID="45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81"
Nov 04 06:08:29.096095 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.096035    4497 scope.go:122] "RemoveContainer" containerID="a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c"
Nov 04 06:08:29.096344 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:29.096321    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c\": container with ID starting with a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c not found: ID does not exist" containerID="a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c"
Nov 04 06:08:29.096387 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.096354    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c"} err="failed to get container status \"a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c\": rpc error: code = NotFound desc = could not find container \"a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c\": container with ID starting with a9ce9645597935495597c3153e712d6ff83890a191ae05efd0beca5cab39f25c not found: ID does not exist"
Nov 04 06:08:29.096387 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.096374    4497 scope.go:122] "RemoveContainer" containerID="45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81"
Nov 04 06:08:29.096640 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:29.096621    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81\": container with ID starting with 45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81 not found: ID does not exist" containerID="45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81"
Nov 04 06:08:29.096699 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.096649    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81"} err="failed to get container status \"45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81\": rpc error: code = NotFound desc = could not find container \"45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81\": container with ID starting with 45578242c2f29f1920bfbef9d54521fb2162bea3c97d8e720ee3d2fa32fb9e81 not found: ID does not exist"
Nov 04 06:08:29.253598 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.253559    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"]
Nov 04 06:08:29.305561 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.305522    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p"]
Nov 04 06:08:29.406068 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.406030    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:29.556451 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.556417    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:29.874275 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.874238    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"]
Nov 04 06:08:29.874518 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.874495    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy" containerID="cri-o://3bbabe3f05ad70b1707ad9f7733e4a701690fe59ca90597e7f31632ffdd24705" gracePeriod=30
Nov 04 06:08:29.915834 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:29.915802    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:30.212681 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:30.212605    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1515409-9b5e-48f5-8eda-5a1075d1135f" path="/var/lib/kubelet/pods/c1515409-9b5e-48f5-8eda-5a1075d1135f/volumes"
Nov 04 06:08:30.213041 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:30.213028    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" path="/var/lib/kubelet/pods/f225a8f6-5390-429f-9dbc-d2cd97e7303c/volumes"
Nov 04 06:08:31.770180 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770142    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"]
Nov 04 06:08:31.770737 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770717    4497 cpu_manager.go:414] "containerMap: removing container" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy"
Nov 04 06:08:31.770833 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770740    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy"
Nov 04 06:08:31.770833 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770769    4497 cpu_manager.go:414] "containerMap: removing container" podUID="c1515409-9b5e-48f5-8eda-5a1075d1135f" containerName="payload-processing"
Nov 04 06:08:31.770833 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770776    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1515409-9b5e-48f5-8eda-5a1075d1135f" containerName="payload-processing"
Nov 04 06:08:31.770833 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770806    4497 cpu_manager.go:414] "containerMap: removing container" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy"
Nov 04 06:08:31.770833 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770814    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy"
Nov 04 06:08:31.771102 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770948    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy"
Nov 04 06:08:31.771102 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770964    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="f225a8f6-5390-429f-9dbc-d2cd97e7303c" containerName="istio-proxy"
Nov 04 06:08:31.771102 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.770976    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1515409-9b5e-48f5-8eda-5a1075d1135f" containerName="payload-processing"
Nov 04 06:08:31.775338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.775318    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.830147 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.830114    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-6b62c0-openshift-default-dockercfg-zkd6q\""
Nov 04 06:08:31.871749 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.871711    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istiod-ca-cert\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.871938 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.871789    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-podinfo\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.871938 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.871870    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.871938 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.871914    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-credential-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.872123 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.871952    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-envoy\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.872123 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.871996    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-token\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.872232 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.872171    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dpjt\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-kube-api-access-6dpjt\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.872283 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.872228    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-certs\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.872340 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.872286    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-data\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.884896 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.884848    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"]
Nov 04 06:08:31.924043 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.924013    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:31.973696 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.973653    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dpjt\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-kube-api-access-6dpjt\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.973870 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.973712    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-certs\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.973870 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.973750    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-data\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.973870 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.973793    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istiod-ca-cert\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.973870 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.973856    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-podinfo\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974144 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.973934    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974144 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.973958    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-credential-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974144 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.974013    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-envoy\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974144 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.974068    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-token\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974347 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.974172    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-certs\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974347 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.974209    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-data\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974530 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.974507    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974595 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.974555    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-credential-socket\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.974595 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.974559    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istiod-ca-cert\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.976429 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.976403    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-envoy\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:31.976608 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:31.976587    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-podinfo\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:32.038349 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:32.038231    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dpjt\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-kube-api-access-6dpjt\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:32.038505 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:32.038436    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-token\") pod \"e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") " pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:32.087717 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:32.087681    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:32.182210 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:32.182172    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:32.528850 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:32.528819    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"]
Nov 04 06:08:32.532075 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:08:32.532043    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a3f512_db5a_4f3c_b3da_45c60a7541e2.slice/crio-075ab0cbdea265d9fa70be5cbe2199a9a10dc9a7dd184a6a92d27ae8b3828b37 WatchSource:0}: Error finding container 075ab0cbdea265d9fa70be5cbe2199a9a10dc9a7dd184a6a92d27ae8b3828b37: Status 404 returned error can't find the container with id 075ab0cbdea265d9fa70be5cbe2199a9a10dc9a7dd184a6a92d27ae8b3828b37
Nov 04 06:08:32.534345 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:32.534306    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:08:32.534463 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:32.534389    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:08:32.534463 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:32.534435    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:08:33.127650 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:33.127614    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" event={"ID":"57a3f512-db5a-4f3c-b3da-45c60a7541e2","Type":"ContainerStarted","Data":"7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2"}
Nov 04 06:08:33.128202 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:33.127666    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" event={"ID":"57a3f512-db5a-4f3c-b3da-45c60a7541e2","Type":"ContainerStarted","Data":"075ab0cbdea265d9fa70be5cbe2199a9a10dc9a7dd184a6a92d27ae8b3828b37"}
Nov 04 06:08:33.255237 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:33.255185    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" podStartSLOduration=2.255168894 podStartE2EDuration="2.255168894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:08:33.25250215 +0000 UTC m=+1161.183699546" watchObservedRunningTime="2026-11-04 06:08:33.255168894 +0000 UTC m=+1161.186366291"
Nov 04 06:08:33.920912 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:33.919360    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:34.088357 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:34.088319    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:34.089871 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:34.089849    4497 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 04 06:08:34.089961 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:34.089938    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 04 06:08:35.088541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.088501    4497 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 04 06:08:35.089036 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.088574    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 04 06:08:35.144260 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.144158    4497 generic.go:356] "Generic (PLEG): container finished" podID="7df4bacd-8439-4779-84c8-322435514bad" containerID="3bbabe3f05ad70b1707ad9f7733e4a701690fe59ca90597e7f31632ffdd24705" exitCode=0
Nov 04 06:08:35.144260 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.144233    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" event={"ID":"7df4bacd-8439-4779-84c8-322435514bad","Type":"ContainerDied","Data":"3bbabe3f05ad70b1707ad9f7733e4a701690fe59ca90597e7f31632ffdd24705"}
Nov 04 06:08:35.144500 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.144315    4497 scope.go:122] "RemoveContainer" containerID="228cb78ca2728876aa6d5059694c29ba7c8ebf0fb076c8e49737cd54ac560cae"
Nov 04 06:08:35.195443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.195419    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:08:35.256291 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.256258    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:35.269235 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.269194    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:35.331456 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331416    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-istio-token\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-istio-token\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.331659 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331466    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7df4bacd-8439-4779-84c8-322435514bad-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df4bacd-8439-4779-84c8-322435514bad-istiod-ca-cert\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.331659 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331512    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-envoy\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.331659 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331631    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7df4bacd-8439-4779-84c8-322435514bad-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df4bacd-8439-4779-84c8-322435514bad-istio-podinfo\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.331832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331701    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-socket\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.331832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331731    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-kube-api-access-xdtg2\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-kube-api-access-xdtg2\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.331832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331794    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-credential-socket\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.332036 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331860    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-certs\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.332036 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331881    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df4bacd-8439-4779-84c8-322435514bad-istiod-ca-cert" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:08:35.332036 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331935    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-data\") pod \"7df4bacd-8439-4779-84c8-322435514bad\" (UID: \"7df4bacd-8439-4779-84c8-322435514bad\") "
Nov 04 06:08:35.332036 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.331988    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-socket" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:35.332231 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.332130    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-credential-socket" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:35.332443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.332307    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-data" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:35.332443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.332419    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-certs" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:35.332544 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.332451    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.332544 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.332466    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.332544 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.332474    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df4bacd-8439-4779-84c8-322435514bad-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.332544 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.332483    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.333920 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.333880    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-envoy" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:35.334035 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.333921    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7df4bacd-8439-4779-84c8-322435514bad-istio-podinfo" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:08:35.334344 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.334322    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-istio-token" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:35.334449 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.334356    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-kube-api-access-xdtg2" pod "7df4bacd-8439-4779-84c8-322435514bad" (UID: "7df4bacd-8439-4779-84c8-322435514bad"). InnerVolumeSpecName "kube-api-access-xdtg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:35.434220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.434131    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdtg2\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-kube-api-access-xdtg2\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.434220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.434168    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.434220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.434183    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7df4bacd-8439-4779-84c8-322435514bad-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.434220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.434196    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df4bacd-8439-4779-84c8-322435514bad-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.434220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.434209    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df4bacd-8439-4779-84c8-322435514bad-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:35.723958 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.723808    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:35.870507 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:35.870473    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:36.088086 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:36.088055    4497 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 04 06:08:36.088232 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:36.088116    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 04 06:08:36.150795 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:36.150767    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"
Nov 04 06:08:36.151296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:36.150810    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd" event={"ID":"7df4bacd-8439-4779-84c8-322435514bad","Type":"ContainerDied","Data":"448179fffe508877d3633189ae218349422113c80343afb7910bb06c6cf6de6e"}
Nov 04 06:08:36.151296 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:36.150868    4497 scope.go:122] "RemoveContainer" containerID="3bbabe3f05ad70b1707ad9f7733e4a701690fe59ca90597e7f31632ffdd24705"
Nov 04 06:08:36.164001 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:36.163977    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:08:36.340124 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:36.340031    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"]
Nov 04 06:08:36.343944 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:36.343917    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd"]
Nov 04 06:08:37.088551 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:37.088514    4497 patch_prober.go:29] interesting pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 04 06:08:37.088743 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:37.088570    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 04 06:08:37.439609 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:37.439522    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:37.924439 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:37.924379    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:37.925652 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:37.925626    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"]
Nov 04 06:08:37.925939 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:37.925879    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerName="istio-proxy" containerID="cri-o://7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2" gracePeriod=30
Nov 04 06:08:38.227099 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:38.227017    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7df4bacd-8439-4779-84c8-322435514bad" path="/var/lib/kubelet/pods/7df4bacd-8439-4779-84c8-322435514bad/volumes"
Nov 04 06:08:39.203725 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:39.203688    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:43.327574 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:43.327535    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:08:44.371561 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.371534    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:44.435113 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435076    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-podinfo\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435113 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435116    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-credential-socket\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435366 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435163    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istiod-ca-cert\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435366 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435188    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-envoy\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435366 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435232    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-token\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-token\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435366 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435267    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-socket\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435366 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435312    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-data\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435366 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435346    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-certs\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435665 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435402    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-kube-api-access-6dpjt\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-kube-api-access-6dpjt\") pod \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\" (UID: \"57a3f512-db5a-4f3c-b3da-45c60a7541e2\") "
Nov 04 06:08:44.435665 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435521    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-credential-socket" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:44.435665 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435599    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istiod-ca-cert" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:08:44.435975 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435864    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-socket" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:44.435975 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435910    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-certs" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:44.435975 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435967    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.435975 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.435989    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.436303 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.436050    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-data" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:44.437642 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.437619    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-podinfo" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:08:44.437798 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.437759    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-envoy" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:08:44.438170 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.438148    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-kube-api-access-6dpjt" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "kube-api-access-6dpjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:44.438270 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.438173    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-token" pod "57a3f512-db5a-4f3c-b3da-45c60a7541e2" (UID: "57a3f512-db5a-4f3c-b3da-45c60a7541e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:08:44.537182 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.537080    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.537182 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.537117    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.537182 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.537131    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.537182 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.537143    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.537182 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.537155    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dpjt\" (UniqueName: \"kubernetes.io/projected/57a3f512-db5a-4f3c-b3da-45c60a7541e2-kube-api-access-6dpjt\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.537182 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.537169    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.537182 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.537181    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a3f512-db5a-4f3c-b3da-45c60a7541e2-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:08:44.600285 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:44.600249    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:45.029978 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.029942    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:45.198624 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.198586    4497 generic.go:356] "Generic (PLEG): container finished" podID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerID="7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2" exitCode=0
Nov 04 06:08:45.198797 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.198633    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"
Nov 04 06:08:45.198797 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.198675    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" event={"ID":"57a3f512-db5a-4f3c-b3da-45c60a7541e2","Type":"ContainerDied","Data":"7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2"}
Nov 04 06:08:45.198797 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.198731    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb" event={"ID":"57a3f512-db5a-4f3c-b3da-45c60a7541e2","Type":"ContainerDied","Data":"075ab0cbdea265d9fa70be5cbe2199a9a10dc9a7dd184a6a92d27ae8b3828b37"}
Nov 04 06:08:45.198797 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.198752    4497 scope.go:122] "RemoveContainer" containerID="7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2"
Nov 04 06:08:45.208587 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.208561    4497 scope.go:122] "RemoveContainer" containerID="7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2"
Nov 04 06:08:45.208873 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:08:45.208856    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2\": container with ID starting with 7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2 not found: ID does not exist" containerID="7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2"
Nov 04 06:08:45.208992 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.208964    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2"} err="failed to get container status \"7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2\": rpc error: code = NotFound desc = could not find container \"7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2\": container with ID starting with 7528ce0ee05bccd0c20b3108ae1d8df3a10b1035e94ab15fc4e943296bcafcd2 not found: ID does not exist"
Nov 04 06:08:45.371166 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.371133    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"]
Nov 04 06:08:45.423910 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:45.423853    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb"]
Nov 04 06:08:46.212029 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:46.211993    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" path="/var/lib/kubelet/pods/57a3f512-db5a-4f3c-b3da-45c60a7541e2/volumes"
Nov 04 06:08:49.711128 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:49.711092    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:50.212847 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.212819    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"]
Nov 04 06:08:50.213220 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.213206    4497 cpu_manager.go:414] "containerMap: removing container" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerName="istio-proxy"
Nov 04 06:08:50.213264 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.213221    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerName="istio-proxy"
Nov 04 06:08:50.213264 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.213244    4497 cpu_manager.go:414] "containerMap: removing container" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy"
Nov 04 06:08:50.213264 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.213249    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy"
Nov 04 06:08:50.213357 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.213267    4497 cpu_manager.go:414] "containerMap: removing container" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy"
Nov 04 06:08:50.213357 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.213272    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy"
Nov 04 06:08:50.213357 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.213328    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy"
Nov 04 06:08:50.213357 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.213338    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="57a3f512-db5a-4f3c-b3da-45c60a7541e2" containerName="istio-proxy"
Nov 04 06:08:50.217777 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.217762    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.301253 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.301205    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"kube-root-ca.crt\""
Nov 04 06:08:50.302676 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.302643    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tmp-dir\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.302796 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.302763    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-home\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.302796 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.302792    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tls-certs\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.302989 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.302822    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-dshm\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.302989 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.302969    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-model-cache\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.303096 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.303012    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s59kf\" (UniqueName: \"kubernetes.io/projected/8588c85a-f6fb-49a0-8bbb-27648a5310fa-kube-api-access-s59kf\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.325979 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.325955    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"openshift-service-ca.crt\""
Nov 04 06:08:50.326161 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.326005    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"distinct-2-w0-f38f69-kserve-self-signed-certs\""
Nov 04 06:08:50.326161 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.326011    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"default-dockercfg-zgpp6\""
Nov 04 06:08:50.328022 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.328001    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"]
Nov 04 06:08:50.363816 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.363765    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:50.404662 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.404624    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-home\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.404662 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.404662    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tls-certs\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.404936 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.404683    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-dshm\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.404936 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.404723    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-model-cache\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.404936 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.404746    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s59kf\" (UniqueName: \"kubernetes.io/projected/8588c85a-f6fb-49a0-8bbb-27648a5310fa-kube-api-access-s59kf\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.404936 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.404813    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tmp-dir\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.405149 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.405075    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-home\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.405149 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.405127    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-model-cache\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.405262 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.405242    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tmp-dir\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.407154 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.407133    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-dshm\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.407455 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.407437    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tls-certs\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.468773 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.468699    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s59kf\" (UniqueName: \"kubernetes.io/projected/8588c85a-f6fb-49a0-8bbb-27648a5310fa-kube-api-access-s59kf\") pod \"distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.529518 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.529483    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:50.911231 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:50.911203    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"]
Nov 04 06:08:50.914071 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:08:50.914044    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8588c85a_f6fb_49a0_8bbb_27648a5310fa.slice/crio-1956327c1f4fb9f511c07f44875f7c8259b9d164d5b97c8571f67da032d834d0 WatchSource:0}: Error finding container 1956327c1f4fb9f511c07f44875f7c8259b9d164d5b97c8571f67da032d834d0: Status 404 returned error can't find the container with id 1956327c1f4fb9f511c07f44875f7c8259b9d164d5b97c8571f67da032d834d0
Nov 04 06:08:51.232997 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:51.232877    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn" event={"ID":"8588c85a-f6fb-49a0-8bbb-27648a5310fa","Type":"ContainerStarted","Data":"a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132"}
Nov 04 06:08:51.232997 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:51.232952    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn" event={"ID":"8588c85a-f6fb-49a0-8bbb-27648a5310fa","Type":"ContainerStarted","Data":"1956327c1f4fb9f511c07f44875f7c8259b9d164d5b97c8571f67da032d834d0"}
Nov 04 06:08:51.355992 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:51.355938    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn" podStartSLOduration=1.3559194909999999 podStartE2EDuration="1.355919491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:08:51.35386446 +0000 UTC m=+1179.285061856" watchObservedRunningTime="2026-11-04 06:08:51.355919491 +0000 UTC m=+1179.287116888"
Nov 04 06:08:51.530452 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:51.530353    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:08:51.635761 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:51.635716    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:51.839723 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:51.839689    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:51.983794 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:51.983756    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:52.131984 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:52.131878    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:54.834538 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:54.834504    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:56.322514 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:56.322483    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:56.473770 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:56.473731    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:58.504741 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:58.504708    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:08:59.893289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:08:59.893254    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:00.277870 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.277789    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"]
Nov 04 06:09:00.278315 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.278283    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="7df4bacd-8439-4779-84c8-322435514bad" containerName="istio-proxy"
Nov 04 06:09:00.281287 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.281272    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.394069 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.394035    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"]
Nov 04 06:09:00.415441 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415383    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.415593 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415475    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjmm\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-kube-api-access-txjmm\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.415593 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415558    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a5136f4-fe72-4211-9b46-bc833adc39a3-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.415681 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415622    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.415681 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415651    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.415762 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415736    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.415808 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415771    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.415871 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415830    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.415871 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.415865    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517300 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517270    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a5136f4-fe72-4211-9b46-bc833adc39a3-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517461 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517326    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517461 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517358    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517461 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517430    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517613 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517460    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517613 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517519    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517613 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517555    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517613 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517610    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517813 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517636    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txjmm\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-kube-api-access-txjmm\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517904 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517855    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.517969 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.517913    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.518045 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.518022    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.518076 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.518050    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.518130 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.518105    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a5136f4-fe72-4211-9b46-bc833adc39a3-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.519932 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.519911    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.520379 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.520361    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.529792 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.529735    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:09:00.542044 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.542025    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:09:00.580439 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.580411    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.580646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.580629    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjmm\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-kube-api-access-txjmm\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:00.594917 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:00.594881    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:01.033702 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.032490    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"]
Nov 04 06:09:01.036393 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:09:01.036362    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5136f4_fe72_4211_9b46_bc833adc39a3.slice/crio-db3d2bf1bff1a9a2c0fd3d2295e8989e88da7a99e77ccdccdd56a6f6f9fad6b9 WatchSource:0}: Error finding container db3d2bf1bff1a9a2c0fd3d2295e8989e88da7a99e77ccdccdd56a6f6f9fad6b9: Status 404 returned error can't find the container with id db3d2bf1bff1a9a2c0fd3d2295e8989e88da7a99e77ccdccdd56a6f6f9fad6b9
Nov 04 06:09:01.038577 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.038546    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:01.038631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.038608    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:01.038663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.038641    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:01.282440 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.282354    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" event={"ID":"9a5136f4-fe72-4211-9b46-bc833adc39a3","Type":"ContainerStarted","Data":"f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba"}
Nov 04 06:09:01.282440 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.282409    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" event={"ID":"9a5136f4-fe72-4211-9b46-bc833adc39a3","Type":"ContainerStarted","Data":"db3d2bf1bff1a9a2c0fd3d2295e8989e88da7a99e77ccdccdd56a6f6f9fad6b9"}
Nov 04 06:09:01.300630 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.297308    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:09:01.409541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.409489    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podStartSLOduration=1.409474426 podStartE2EDuration="1.409474426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:01.407481224 +0000 UTC m=+1189.338678643" watchObservedRunningTime="2026-11-04 06:09:01.409474426 +0000 UTC m=+1189.340671822"
Nov 04 06:09:01.595951 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:01.595923    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:02.597861 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:02.597828    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 06:09:02.598417 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:02.597922    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 06:09:03.463001 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:03.462969    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"]
Nov 04 06:09:03.595812 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:03.595776    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 06:09:03.596015 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:03.595839    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 06:09:03.624604 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:03.624562    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:04.596459 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:04.596428    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 06:09:04.596641 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:04.596476    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 06:09:05.124657 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:05.124624    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:05.596188 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:05.596159    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 06:09:05.596354 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:05.596215    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 06:09:06.596181 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:06.596147    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 06:09:06.596576 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:06.596205    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 06:09:07.595276 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:07.595243    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 06:09:07.595488 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:07.595307    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 06:09:08.599637 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:08.599608    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:08.600050 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:08.599915    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:08.600505 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:08.600489    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:09.312384 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:09.312350    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:10.657293 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:10.657223    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:13.327266 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:09:13.327234    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:09:15.295866 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:15.295820    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:15.918612 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:15.918571    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:16.881450 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:16.881417    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:17.032574 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:17.032523    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:18.483925 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.483867    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n" podUID="1bf11679-e8d8-438d-be95-b687f4974b0e" containerName="main" containerID="cri-o://b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f" gracePeriod=45
Nov 04 06:09:18.834952 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.834916    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:09:18.938911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.937308    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-model-cache\") pod \"1bf11679-e8d8-438d-be95-b687f4974b0e\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") "
Nov 04 06:09:18.938911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.937396    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1bf11679-e8d8-438d-be95-b687f4974b0e-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bf11679-e8d8-438d-be95-b687f4974b0e-tls-certs\") pod \"1bf11679-e8d8-438d-be95-b687f4974b0e\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") "
Nov 04 06:09:18.938911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.937463    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-home\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-home\") pod \"1bf11679-e8d8-438d-be95-b687f4974b0e\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") "
Nov 04 06:09:18.938911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.937542    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-dshm\") pod \"1bf11679-e8d8-438d-be95-b687f4974b0e\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") "
Nov 04 06:09:18.938911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.937612    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-tmp-dir\") pod \"1bf11679-e8d8-438d-be95-b687f4974b0e\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") "
Nov 04 06:09:18.938911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.937647    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1bf11679-e8d8-438d-be95-b687f4974b0e-kube-api-access-tfhsw\" (UniqueName: \"kubernetes.io/projected/1bf11679-e8d8-438d-be95-b687f4974b0e-kube-api-access-tfhsw\") pod \"1bf11679-e8d8-438d-be95-b687f4974b0e\" (UID: \"1bf11679-e8d8-438d-be95-b687f4974b0e\") "
Nov 04 06:09:18.939431 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.939113    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-model-cache" pod "1bf11679-e8d8-438d-be95-b687f4974b0e" (UID: "1bf11679-e8d8-438d-be95-b687f4974b0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:18.940273 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.940233    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-tmp-dir" pod "1bf11679-e8d8-438d-be95-b687f4974b0e" (UID: "1bf11679-e8d8-438d-be95-b687f4974b0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:18.940627 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.940595    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-home" pod "1bf11679-e8d8-438d-be95-b687f4974b0e" (UID: "1bf11679-e8d8-438d-be95-b687f4974b0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:18.953103 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.953053    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-dshm" pod "1bf11679-e8d8-438d-be95-b687f4974b0e" (UID: "1bf11679-e8d8-438d-be95-b687f4974b0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:18.953599 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.953559    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bf11679-e8d8-438d-be95-b687f4974b0e-tls-certs" pod "1bf11679-e8d8-438d-be95-b687f4974b0e" (UID: "1bf11679-e8d8-438d-be95-b687f4974b0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:09:18.953928 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:18.953907    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf11679-e8d8-438d-be95-b687f4974b0e-kube-api-access-tfhsw" pod "1bf11679-e8d8-438d-be95-b687f4974b0e" (UID: "1bf11679-e8d8-438d-be95-b687f4974b0e"). InnerVolumeSpecName "kube-api-access-tfhsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:09:19.062053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.046735    4497 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-tmp-dir\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:19.062053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.046781    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfhsw\" (UniqueName: \"kubernetes.io/projected/1bf11679-e8d8-438d-be95-b687f4974b0e-kube-api-access-tfhsw\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:19.062053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.046801    4497 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-model-cache\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:19.062053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.046817    4497 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bf11679-e8d8-438d-be95-b687f4974b0e-tls-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:19.062053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.046831    4497 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-home\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:19.062053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.046845    4497 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bf11679-e8d8-438d-be95-b687f4974b0e-dshm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:19.401340 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.401298    4497 generic.go:356] "Generic (PLEG): container finished" podID="1bf11679-e8d8-438d-be95-b687f4974b0e" containerID="b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f" exitCode=0
Nov 04 06:09:19.401559 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.401366    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"
Nov 04 06:09:19.401559 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.401373    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n" event={"ID":"1bf11679-e8d8-438d-be95-b687f4974b0e","Type":"ContainerDied","Data":"b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f"}
Nov 04 06:09:19.401559 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.401414    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n" event={"ID":"1bf11679-e8d8-438d-be95-b687f4974b0e","Type":"ContainerDied","Data":"46145aee2c4e0de45a9d72863e08598177422e133417730434c0e47fbb4a33df"}
Nov 04 06:09:19.401559 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.401435    4497 scope.go:122] "RemoveContainer" containerID="b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f"
Nov 04 06:09:19.418996 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.415046    4497 scope.go:122] "RemoveContainer" containerID="b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f"
Nov 04 06:09:19.418996 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:09:19.418064    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f\": container with ID starting with b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f not found: ID does not exist" containerID="b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f"
Nov 04 06:09:19.418996 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.418107    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f"} err="failed to get container status \"b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f\": rpc error: code = NotFound desc = could not find container \"b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f\": container with ID starting with b6e3caefee7846b8b058e6698f85232cad7fce32930c9626eb42b11fbd40596f not found: ID does not exist"
Nov 04 06:09:19.582105 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.582066    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"]
Nov 04 06:09:19.586020 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:19.585979    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/distinct-2-w4-856c68-kserve-67d7dbf8d8-xw46n"]
Nov 04 06:09:20.218078 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:20.218041    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1bf11679-e8d8-438d-be95-b687f4974b0e" path="/var/lib/kubelet/pods/1bf11679-e8d8-438d-be95-b687f4974b0e/volumes"
Nov 04 06:09:20.977994 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:20.977947    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:21.614320 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:21.614284    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:26.099284 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:26.099201    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:27.620326 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:27.620291    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:28.504216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:28.504176    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:30.969033 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:30.968995    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"]
Nov 04 06:09:30.969608 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:30.969586    4497 cpu_manager.go:414] "containerMap: removing container" podUID="1bf11679-e8d8-438d-be95-b687f4974b0e" containerName="main"
Nov 04 06:09:30.969697 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:30.969611    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1bf11679-e8d8-438d-be95-b687f4974b0e" containerName="main"
Nov 04 06:09:30.969756 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:30.969702    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="1bf11679-e8d8-438d-be95-b687f4974b0e" containerName="main"
Nov 04 06:09:30.972781 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:30.972758    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.090404 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.090359    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.090575 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.090493    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.090575 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.090533    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkrzx\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-kube-api-access-gkrzx\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.090575 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.090554    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.090739 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.090581    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.090787 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.090768    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.090830 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.090816    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.090917 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.090861    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6b2eecc-b058-45fc-9339-1e4d62da928b-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.091025 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.091010    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192291 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192243    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192482 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192305    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkrzx\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-kube-api-access-gkrzx\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192482 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192335    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192482 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192372    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192482 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192421    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192717 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192642    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192717 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192696    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6b2eecc-b058-45fc-9339-1e4d62da928b-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192828 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192782    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.192922 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.192825    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.193606 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.193583    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.195446 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.195419    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.196255 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.195695    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:31.196255 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.196127    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.196255 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.196212    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6b2eecc-b058-45fc-9339-1e4d62da928b-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.196742 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.196335    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.196742 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.196505    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"]
Nov 04 06:09:31.199372 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.199348    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.199790 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.199769    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.259509 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.259386    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.259702 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.259680    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkrzx\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-kube-api-access-gkrzx\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.289046 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.289018    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:31.736447 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.736415    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"]
Nov 04 06:09:31.738841 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:09:31.738814    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b2eecc_b058_45fc_9339_1e4d62da928b.slice/crio-d31c6710c6fd07d59cf78c19ceb9a11dd8452e8e524936be8c08864d2aef954c WatchSource:0}: Error finding container d31c6710c6fd07d59cf78c19ceb9a11dd8452e8e524936be8c08864d2aef954c: Status 404 returned error can't find the container with id d31c6710c6fd07d59cf78c19ceb9a11dd8452e8e524936be8c08864d2aef954c
Nov 04 06:09:31.741752 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.741707    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:31.741864 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.741800    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:31.741864 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:31.741846    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:32.484206 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:32.484157    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" event={"ID":"a6b2eecc-b058-45fc-9339-1e4d62da928b","Type":"ContainerStarted","Data":"5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e"}
Nov 04 06:09:32.484706 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:32.484300    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" event={"ID":"a6b2eecc-b058-45fc-9339-1e4d62da928b","Type":"ContainerStarted","Data":"d31c6710c6fd07d59cf78c19ceb9a11dd8452e8e524936be8c08864d2aef954c"}
Nov 04 06:09:32.618189 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:32.618123    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" podStartSLOduration=2.618101824 podStartE2EDuration="2.618101824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:32.615428706 +0000 UTC m=+1220.546626125" watchObservedRunningTime="2026-11-04 06:09:32.618101824 +0000 UTC m=+1220.549299223"
Nov 04 06:09:33.290030 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:33.290001    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:33.291420 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:33.291383    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 06:09:33.291550 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:33.291450    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 06:09:34.290366 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:34.290328    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 06:09:34.290771 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:34.290390    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 06:09:35.289787 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:35.289747    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 06:09:35.290017 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:35.289813    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 06:09:36.290363 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:36.290323    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 06:09:36.290974 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:36.290390    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 06:09:36.583178 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:36.583085    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:37.289729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:37.289695    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 06:09:37.289942 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:37.289751    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 06:09:38.290219 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:38.290184    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 06:09:38.290219 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:38.290246    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 06:09:38.916148 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:38.916117    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:39.067105 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:39.067060    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:39.293817 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:39.293733    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:39.294289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:39.294098    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:39.294810 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:39.294769    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:09:39.660830 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:39.660796    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:41.720569 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:41.720532    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:43.328149 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:09:43.328112    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:09:45.349172 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.349134    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:45.715750 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.715661    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"]
Nov 04 06:09:45.719692 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.719673    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817143 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817097    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817145    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817269    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2af72df-6063-4b3b-975d-90c5fddcc403-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817301    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817507 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817340    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817507 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817405    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817507 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817455    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817657 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817535    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4swb\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-kube-api-access-m4swb\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.817657 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.817574    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918362 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918297    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918545 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918412    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4swb\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-kube-api-access-m4swb\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918545 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918459    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918545 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918524    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918705 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918567    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918705 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918606    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2af72df-6063-4b3b-975d-90c5fddcc403-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918705 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918631    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918705 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918681    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.918949 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918718    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.919015 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.918992    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.919122 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.919098    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.919264 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.919244    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.919335 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.919271    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.919605 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.919578    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2af72df-6063-4b3b-975d-90c5fddcc403-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.921094 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.921065    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.921386 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.921366    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.941345 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.941307    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"]
Nov 04 06:09:45.982258 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.982174    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:45.982445 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:45.982287    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4swb\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-kube-api-access-m4swb\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:46.014499 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.014466    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"]
Nov 04 06:09:46.014707 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.014686    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97" podUID="16268c2b-9813-4248-87cf-77890439be44" containerName="maas-api" containerID="cri-o://20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8" gracePeriod=30
Nov 04 06:09:46.033546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.033508    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:46.114621 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.114594    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:46.484526 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.484499    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"]
Nov 04 06:09:46.485943 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:09:46.485912    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2af72df_6063_4b3b_975d_90c5fddcc403.slice/crio-ed6edb038b75b69cf42fa477dbef361de0738257c4aae80ee011b835a0bc4ab2 WatchSource:0}: Error finding container ed6edb038b75b69cf42fa477dbef361de0738257c4aae80ee011b835a0bc4ab2: Status 404 returned error can't find the container with id ed6edb038b75b69cf42fa477dbef361de0738257c4aae80ee011b835a0bc4ab2
Nov 04 06:09:46.488415 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.488372    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:46.488510 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.488448    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:46.488510 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.488484    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:09:46.583099 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.583058    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" event={"ID":"b2af72df-6063-4b3b-975d-90c5fddcc403","Type":"ContainerStarted","Data":"61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64"}
Nov 04 06:09:46.583406 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.583135    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" event={"ID":"b2af72df-6063-4b3b-975d-90c5fddcc403","Type":"ContainerStarted","Data":"ed6edb038b75b69cf42fa477dbef361de0738257c4aae80ee011b835a0bc4ab2"}
Nov 04 06:09:46.709403 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:46.709267    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" podStartSLOduration=1.709250032 podStartE2EDuration="1.709250032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:46.708093467 +0000 UTC m=+1234.639290863" watchObservedRunningTime="2026-11-04 06:09:46.709250032 +0000 UTC m=+1234.640447431"
Nov 04 06:09:47.036949 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.035907    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:09:47.039918 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.037738    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 06:09:47.039918 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.037819    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 06:09:47.116551 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.116438    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97" podUID="16268c2b-9813-4248-87cf-77890439be44" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.42:8443/health\": dial tcp 10.133.0.42:8443: connect: connection refused"
Nov 04 06:09:47.229165 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.229106    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:47.290344 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.290241    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:09:47.440109 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.440078    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-metrics-certs\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-metrics-certs\") pod \"16268c2b-9813-4248-87cf-77890439be44\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") "
Nov 04 06:09:47.440313 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.440212    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls\") pod \"16268c2b-9813-4248-87cf-77890439be44\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") "
Nov 04 06:09:47.440313 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.440284    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16268c2b-9813-4248-87cf-77890439be44-kube-api-access-7l7rz\" (UniqueName: \"kubernetes.io/projected/16268c2b-9813-4248-87cf-77890439be44-kube-api-access-7l7rz\") pod \"16268c2b-9813-4248-87cf-77890439be44\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") "
Nov 04 06:09:47.440864 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.440332    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16268c2b-9813-4248-87cf-77890439be44-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16268c2b-9813-4248-87cf-77890439be44-openshift-service-ca\") pod \"16268c2b-9813-4248-87cf-77890439be44\" (UID: \"16268c2b-9813-4248-87cf-77890439be44\") "
Nov 04 06:09:47.440864 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.440779    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16268c2b-9813-4248-87cf-77890439be44-openshift-service-ca" pod "16268c2b-9813-4248-87cf-77890439be44" (UID: "16268c2b-9813-4248-87cf-77890439be44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:09:47.442684 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.442660    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16268c2b-9813-4248-87cf-77890439be44-kube-api-access-7l7rz" pod "16268c2b-9813-4248-87cf-77890439be44" (UID: "16268c2b-9813-4248-87cf-77890439be44"). InnerVolumeSpecName "kube-api-access-7l7rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:09:47.443215 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.443196    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls" pod "16268c2b-9813-4248-87cf-77890439be44" (UID: "16268c2b-9813-4248-87cf-77890439be44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:09:47.443308 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.443220    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-metrics-certs" pod "16268c2b-9813-4248-87cf-77890439be44" (UID: "16268c2b-9813-4248-87cf-77890439be44"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:09:47.543100 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.543010    4497 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-maas-api-tls\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:47.543100 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.543038    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l7rz\" (UniqueName: \"kubernetes.io/projected/16268c2b-9813-4248-87cf-77890439be44-kube-api-access-7l7rz\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:47.543100 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.543047    4497 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16268c2b-9813-4248-87cf-77890439be44-openshift-service-ca\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:47.543100 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.543058    4497 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16268c2b-9813-4248-87cf-77890439be44-metrics-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:47.590126 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.590089    4497 generic.go:356] "Generic (PLEG): container finished" podID="16268c2b-9813-4248-87cf-77890439be44" containerID="20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8" exitCode=0
Nov 04 06:09:47.590330 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.590187    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"
Nov 04 06:09:47.590330 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.590223    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97" event={"ID":"16268c2b-9813-4248-87cf-77890439be44","Type":"ContainerDied","Data":"20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8"}
Nov 04 06:09:47.590330 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.590279    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97" event={"ID":"16268c2b-9813-4248-87cf-77890439be44","Type":"ContainerDied","Data":"aea7e40ae8ebc6600a6769a4457aeb3afda00f914f1efa7c34440b5a42518354"}
Nov 04 06:09:47.590330 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.590326    4497 scope.go:122] "RemoveContainer" containerID="20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8"
Nov 04 06:09:47.624532 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.624504    4497 scope.go:122] "RemoveContainer" containerID="20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8"
Nov 04 06:09:47.624970 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:09:47.624945    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8\": container with ID starting with 20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8 not found: ID does not exist" containerID="20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8"
Nov 04 06:09:47.625094 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.624976    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8"} err="failed to get container status \"20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8\": rpc error: code = NotFound desc = could not find container \"20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8\": container with ID starting with 20814505767e19e13265fc2d5568764b0ecb3b68524274dbb3a9a45c798cf2a8 not found: ID does not exist"
Nov 04 06:09:47.783229 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.783194    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"]
Nov 04 06:09:47.788718 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:47.788690    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-856c68-6fd89b8fcc-bjf97"]
Nov 04 06:09:48.035005 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:48.034968    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 06:09:48.035190 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:48.035025    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 06:09:48.040191 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:48.040157    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:48.226829 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:48.226792    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16268c2b-9813-4248-87cf-77890439be44" path="/var/lib/kubelet/pods/16268c2b-9813-4248-87cf-77890439be44/volumes"
Nov 04 06:09:48.756761 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:48.756730    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:48.913921 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:48.913444    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:49.034266 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:49.034179    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 06:09:49.034266 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:49.034247    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 06:09:50.034189 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.034152    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 06:09:50.034627 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.034224    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 06:09:50.419912 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.419629    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:50.923878 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.923845    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:50.925767 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.925745    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"]
Nov 04 06:09:50.926018 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.925997    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerName="istio-proxy" containerID="cri-o://61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64" gracePeriod=30
Nov 04 06:09:50.928099 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.928074    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"]
Nov 04 06:09:50.928294 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.928276    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy" containerID="cri-o://35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361" gracePeriod=30
Nov 04 06:09:50.948910 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.948861    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"]
Nov 04 06:09:50.949076 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:50.949058    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy" containerID="cri-o://f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba" gracePeriod=30
Nov 04 06:09:51.562989 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:51.562949    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:51.724368 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:51.724334    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:52.176050 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:52.176018    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"]
Nov 04 06:09:52.335503 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:52.335470    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:53.404475 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:53.404437    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:53.604930 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:53.603642    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 06:09:53.604930 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:53.603703    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 06:09:54.142914 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:54.142851    4497 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 06:09:54.143108 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:54.142942    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 06:09:55.219552 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:55.219513    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:09:56.199742 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.199669    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:09:56.228200 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.228180    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:56.374136 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374106    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-token\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-token\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.374338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374143    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-socket\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.374338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374161    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-podinfo\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.374338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374189    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-credential-socket\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.374338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374215    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-kube-api-access-txjmm\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-kube-api-access-txjmm\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.374338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374244    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-certs\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.374338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374264    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-data\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374345    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-certs\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374385    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-socket\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374448    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d102d6b7-9522-4824-a62b-7817609622ee-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d102d6b7-9522-4824-a62b-7817609622ee-istio-podinfo\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374449    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-socket" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374501    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-istio-token\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-istio-token\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374547    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d102d6b7-9522-4824-a62b-7817609622ee-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d102d6b7-9522-4824-a62b-7817609622ee-istiod-ca-cert\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374556    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-credential-socket" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374595    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-kube-api-access-mgxwn\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-kube-api-access-mgxwn\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374636    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-credential-socket\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.374729 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374696    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-envoy\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.375443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374742    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-data\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.375443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374787    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-envoy\") pod \"d102d6b7-9522-4824-a62b-7817609622ee\" (UID: \"d102d6b7-9522-4824-a62b-7817609622ee\") "
Nov 04 06:09:56.375443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374815    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a5136f4-fe72-4211-9b46-bc833adc39a3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a5136f4-fe72-4211-9b46-bc833adc39a3-istiod-ca-cert\") pod \"9a5136f4-fe72-4211-9b46-bc833adc39a3\" (UID: \"9a5136f4-fe72-4211-9b46-bc833adc39a3\") "
Nov 04 06:09:56.375443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374678    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-certs" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.375443 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374770    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-data" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.375690 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374783    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-certs" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.375690 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.374716    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-socket" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.375690 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.375046    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d102d6b7-9522-4824-a62b-7817609622ee-istiod-ca-cert" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:09:56.375690 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.375345    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-data" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.375907 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.375869    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.375969 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.375909    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.376021 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.375975    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-credential-socket" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.376130 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.376096    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5136f4-fe72-4211-9b46-bc833adc39a3-istiod-ca-cert" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:09:56.377002 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.376966    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-token" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:09:56.377702 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.377675    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d102d6b7-9522-4824-a62b-7817609622ee-istio-podinfo" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:09:56.377812 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.377725    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-kube-api-access-txjmm" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "kube-api-access-txjmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:09:56.377812 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.377762    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-podinfo" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:09:56.378509 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.378471    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-envoy" pod "9a5136f4-fe72-4211-9b46-bc833adc39a3" (UID: "9a5136f4-fe72-4211-9b46-bc833adc39a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.378678 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.378658    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-envoy" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:09:56.379060 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.379036    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-istio-token" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:09:56.379438 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.379401    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-kube-api-access-mgxwn" pod "d102d6b7-9522-4824-a62b-7817609622ee" (UID: "d102d6b7-9522-4824-a62b-7817609622ee"). InnerVolumeSpecName "kube-api-access-mgxwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:09:56.476986 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.476881    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgxwn\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-kube-api-access-mgxwn\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.476986 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.476937    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.476986 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.476948    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.476986 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.476962    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.476986 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.476973    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.476986 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.476981    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a5136f4-fe72-4211-9b46-bc833adc39a3-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.476986 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.476990    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.476998    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.477007    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txjmm\" (UniqueName: \"kubernetes.io/projected/9a5136f4-fe72-4211-9b46-bc833adc39a3-kube-api-access-txjmm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.477015    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d102d6b7-9522-4824-a62b-7817609622ee-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.477023    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.477036    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.477049    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a5136f4-fe72-4211-9b46-bc833adc39a3-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.477057    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d102d6b7-9522-4824-a62b-7817609622ee-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.477066    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d102d6b7-9522-4824-a62b-7817609622ee-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.477289 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.477073    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d102d6b7-9522-4824-a62b-7817609622ee-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:09:56.658470 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.658433    4497 generic.go:356] "Generic (PLEG): container finished" podID="d102d6b7-9522-4824-a62b-7817609622ee" containerID="35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361" exitCode=0
Nov 04 06:09:56.658654 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.658488    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"
Nov 04 06:09:56.658654 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.658512    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" event={"ID":"d102d6b7-9522-4824-a62b-7817609622ee","Type":"ContainerDied","Data":"35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361"}
Nov 04 06:09:56.658654 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.658566    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w" event={"ID":"d102d6b7-9522-4824-a62b-7817609622ee","Type":"ContainerDied","Data":"626d043528bad48eea4d15b3f9d89730cbbf1e46f883ef932f53cde1ebcc52b3"}
Nov 04 06:09:56.658654 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.658590    4497 scope.go:122] "RemoveContainer" containerID="35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361"
Nov 04 06:09:56.663918 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.660316    4497 generic.go:356] "Generic (PLEG): container finished" podID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerID="f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba" exitCode=0
Nov 04 06:09:56.663918 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.660374    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" event={"ID":"9a5136f4-fe72-4211-9b46-bc833adc39a3","Type":"ContainerDied","Data":"f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba"}
Nov 04 06:09:56.663918 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.660412    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m" event={"ID":"9a5136f4-fe72-4211-9b46-bc833adc39a3","Type":"ContainerDied","Data":"db3d2bf1bff1a9a2c0fd3d2295e8989e88da7a99e77ccdccdd56a6f6f9fad6b9"}
Nov 04 06:09:56.663918 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.660477    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"
Nov 04 06:09:56.674254 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.671801    4497 scope.go:122] "RemoveContainer" containerID="b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb"
Nov 04 06:09:56.685824 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.685805    4497 scope.go:122] "RemoveContainer" containerID="35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361"
Nov 04 06:09:56.686095 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:09:56.686074    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361\": container with ID starting with 35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361 not found: ID does not exist" containerID="35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361"
Nov 04 06:09:56.686164 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.686102    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361"} err="failed to get container status \"35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361\": rpc error: code = NotFound desc = could not find container \"35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361\": container with ID starting with 35dbc07307af3576aebdee70bf279128846c2186bf3b10718110d9e7e01e1361 not found: ID does not exist"
Nov 04 06:09:56.686164 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.686119    4497 scope.go:122] "RemoveContainer" containerID="b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb"
Nov 04 06:09:56.686383 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:09:56.686365    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb\": container with ID starting with b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb not found: ID does not exist" containerID="b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb"
Nov 04 06:09:56.686429 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.686387    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb"} err="failed to get container status \"b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb\": rpc error: code = NotFound desc = could not find container \"b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb\": container with ID starting with b60a00d4c626dba218ee6a8c64114704781d740b8ddc314e415415ba0391a9bb not found: ID does not exist"
Nov 04 06:09:56.686429 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.686400    4497 scope.go:122] "RemoveContainer" containerID="f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba"
Nov 04 06:09:56.694122 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.694105    4497 scope.go:122] "RemoveContainer" containerID="f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba"
Nov 04 06:09:56.694401 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:09:56.694381    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba\": container with ID starting with f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba not found: ID does not exist" containerID="f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba"
Nov 04 06:09:56.694455 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.694408    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba"} err="failed to get container status \"f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba\": rpc error: code = NotFound desc = could not find container \"f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba\": container with ID starting with f507d0663d96e3e756c50bd4c5b2fca9cabb705a7cc31e5ae683023b6b6b27ba not found: ID does not exist"
Nov 04 06:09:56.831621 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.831536    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"]
Nov 04 06:09:56.835494 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.835470    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w"]
Nov 04 06:09:56.951926 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.951881    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"]
Nov 04 06:09:56.956056 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:56.956029    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m"]
Nov 04 06:09:58.212934 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:58.212905    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" path="/var/lib/kubelet/pods/9a5136f4-fe72-4211-9b46-bc833adc39a3/volumes"
Nov 04 06:09:58.213343 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:58.213330    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d102d6b7-9522-4824-a62b-7817609622ee" path="/var/lib/kubelet/pods/d102d6b7-9522-4824-a62b-7817609622ee/volumes"
Nov 04 06:09:58.792528 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:09:58.792486    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:00.186418 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.186384    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"]
Nov 04 06:10:00.238522 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.238490    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"]
Nov 04 06:10:00.384754 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.384724    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:00.580064 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.580034    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:10:00.621413 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621379    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-data\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621576 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621421    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-credential-socket\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621576 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621462    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-socket\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621576 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621495    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-envoy\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621576 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621528    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-certs\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621576 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621557    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-token\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-token\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621789 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621598    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-kube-api-access-m4swb\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-kube-api-access-m4swb\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621789 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621631    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2af72df-6063-4b3b-975d-90c5fddcc403-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2af72df-6063-4b3b-975d-90c5fddcc403-istiod-ca-cert\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621789 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621663    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-data" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:00.621789 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621744    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-podinfo\") pod \"b2af72df-6063-4b3b-975d-90c5fddcc403\" (UID: \"b2af72df-6063-4b3b-975d-90c5fddcc403\") "
Nov 04 06:10:00.621789 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621749    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-credential-socket" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:00.622047 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621874    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-socket" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:00.622047 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.621987    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-certs" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:00.622143 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.622121    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2af72df-6063-4b3b-975d-90c5fddcc403-istiod-ca-cert" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:00.622287 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.622256    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.622379 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.622292    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.622379 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.622324    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.622379 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.622338    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.622379 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.622352    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2af72df-6063-4b3b-975d-90c5fddcc403-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.624173 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.624143    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-token" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:00.624173 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.624167    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-podinfo" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:10:00.624425 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.624403    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-envoy" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:00.624517 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.624426    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-kube-api-access-m4swb" pod "b2af72df-6063-4b3b-975d-90c5fddcc403" (UID: "b2af72df-6063-4b3b-975d-90c5fddcc403"). InnerVolumeSpecName "kube-api-access-m4swb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:00.682462 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.682428    4497 generic.go:356] "Generic (PLEG): container finished" podID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerID="61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64" exitCode=0
Nov 04 06:10:00.682631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.682471    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" event={"ID":"b2af72df-6063-4b3b-975d-90c5fddcc403","Type":"ContainerDied","Data":"61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64"}
Nov 04 06:10:00.682631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.682485    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"
Nov 04 06:10:00.682631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.682513    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4" event={"ID":"b2af72df-6063-4b3b-975d-90c5fddcc403","Type":"ContainerDied","Data":"ed6edb038b75b69cf42fa477dbef361de0738257c4aae80ee011b835a0bc4ab2"}
Nov 04 06:10:00.682631 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.682534    4497 scope.go:122] "RemoveContainer" containerID="61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64"
Nov 04 06:10:00.691946 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.691924    4497 scope.go:122] "RemoveContainer" containerID="61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64"
Nov 04 06:10:00.692238 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:00.692219    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64\": container with ID starting with 61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64 not found: ID does not exist" containerID="61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64"
Nov 04 06:10:00.692302 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.692248    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64"} err="failed to get container status \"61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64\": rpc error: code = NotFound desc = could not find container \"61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64\": container with ID starting with 61c776bdbba4255d8e31c211afba3e308bf0befb4822e13773c22e70fcb0cc64 not found: ID does not exist"
Nov 04 06:10:00.723675 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.723647    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.723675 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.723674    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.723853 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.723690    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4swb\" (UniqueName: \"kubernetes.io/projected/b2af72df-6063-4b3b-975d-90c5fddcc403-kube-api-access-m4swb\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.723853 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.723705    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2af72df-6063-4b3b-975d-90c5fddcc403-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:00.822662 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.822629    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"]
Nov 04 06:10:00.826585 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:00.826552    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4"]
Nov 04 06:10:02.213429 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:02.213385    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" path="/var/lib/kubelet/pods/b2af72df-6063-4b3b-975d-90c5fddcc403/volumes"
Nov 04 06:10:02.436826 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:02.436789    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:03.892461 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:03.892427    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:07.196303 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.196263    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn" podUID="8588c85a-f6fb-49a0-8bbb-27648a5310fa" containerName="main" containerID="cri-o://a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132" gracePeriod=45
Nov 04 06:10:07.283776 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.283748    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn" podUID="8588c85a-f6fb-49a0-8bbb-27648a5310fa" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": dial tcp 10.133.0.59:8000: connect: connection refused"
Nov 04 06:10:07.448218 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.448154    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:10:07.489661 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.489636    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8588c85a-f6fb-49a0-8bbb-27648a5310fa-kube-api-access-s59kf\" (UniqueName: \"kubernetes.io/projected/8588c85a-f6fb-49a0-8bbb-27648a5310fa-kube-api-access-s59kf\") pod \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") "
Nov 04 06:10:07.489787 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.489691    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-model-cache\") pod \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") "
Nov 04 06:10:07.489787 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.489748    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-home\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-home\") pod \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") "
Nov 04 06:10:07.489787 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.489768    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tls-certs\" (UniqueName: \"kubernetes.io/secret/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tls-certs\") pod \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") "
Nov 04 06:10:07.489921 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.489788    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-dshm\") pod \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") "
Nov 04 06:10:07.489921 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.489847    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tmp-dir\") pod \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\" (UID: \"8588c85a-f6fb-49a0-8bbb-27648a5310fa\") "
Nov 04 06:10:07.490022 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.489981    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-model-cache" pod "8588c85a-f6fb-49a0-8bbb-27648a5310fa" (UID: "8588c85a-f6fb-49a0-8bbb-27648a5310fa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:07.490022 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.490008    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-home" pod "8588c85a-f6fb-49a0-8bbb-27648a5310fa" (UID: "8588c85a-f6fb-49a0-8bbb-27648a5310fa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:07.490200 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.490177    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tmp-dir" pod "8588c85a-f6fb-49a0-8bbb-27648a5310fa" (UID: "8588c85a-f6fb-49a0-8bbb-27648a5310fa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:07.490364 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.490307    4497 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-model-cache\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:07.490364 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.490329    4497 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-home\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:07.490364 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.490345    4497 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tmp-dir\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:07.492093 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.492068    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8588c85a-f6fb-49a0-8bbb-27648a5310fa-kube-api-access-s59kf" pod "8588c85a-f6fb-49a0-8bbb-27648a5310fa" (UID: "8588c85a-f6fb-49a0-8bbb-27648a5310fa"). InnerVolumeSpecName "kube-api-access-s59kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:07.492184 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.492121    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tls-certs" pod "8588c85a-f6fb-49a0-8bbb-27648a5310fa" (UID: "8588c85a-f6fb-49a0-8bbb-27648a5310fa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:10:07.492184 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.492173    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-dshm" pod "8588c85a-f6fb-49a0-8bbb-27648a5310fa" (UID: "8588c85a-f6fb-49a0-8bbb-27648a5310fa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:07.590796 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.590772    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s59kf\" (UniqueName: \"kubernetes.io/projected/8588c85a-f6fb-49a0-8bbb-27648a5310fa-kube-api-access-s59kf\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:07.590796 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.590793    4497 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8588c85a-f6fb-49a0-8bbb-27648a5310fa-tls-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:07.591009 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.590803    4497 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8588c85a-f6fb-49a0-8bbb-27648a5310fa-dshm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:07.725033 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.724951    4497 generic.go:356] "Generic (PLEG): container finished" podID="8588c85a-f6fb-49a0-8bbb-27648a5310fa" containerID="a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132" exitCode=0
Nov 04 06:10:07.725033 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.724991    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"
Nov 04 06:10:07.725033 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.725018    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn" event={"ID":"8588c85a-f6fb-49a0-8bbb-27648a5310fa","Type":"ContainerDied","Data":"a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132"}
Nov 04 06:10:07.725259 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.725059    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn" event={"ID":"8588c85a-f6fb-49a0-8bbb-27648a5310fa","Type":"ContainerDied","Data":"1956327c1f4fb9f511c07f44875f7c8259b9d164d5b97c8571f67da032d834d0"}
Nov 04 06:10:07.725259 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.725076    4497 scope.go:122] "RemoveContainer" containerID="a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132"
Nov 04 06:10:07.734659 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.734637    4497 scope.go:122] "RemoveContainer" containerID="a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132"
Nov 04 06:10:07.735053 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:07.734982    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132\": container with ID starting with a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132 not found: ID does not exist" containerID="a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132"
Nov 04 06:10:07.735173 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.735062    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132"} err="failed to get container status \"a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132\": rpc error: code = NotFound desc = could not find container \"a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132\": container with ID starting with a59540ac5f584f7387920ee97b306c99ce2d29f5f71bcb31fb7573ea4a115132 not found: ID does not exist"
Nov 04 06:10:07.895939 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.895911    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"]
Nov 04 06:10:07.899554 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:07.899532    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-2-w0-f38f69-kserve-596c9b9b4b-xq2qn"]
Nov 04 06:10:08.211794 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:08.211764    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8588c85a-f6fb-49a0-8bbb-27648a5310fa" path="/var/lib/kubelet/pods/8588c85a-f6fb-49a0-8bbb-27648a5310fa/volumes"
Nov 04 06:10:08.877233 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:08.877196    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:09.082587 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:09.082550    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:09.661870 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:09.661834    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:09.803701 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:09.803671    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:10.304406 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:10.304357    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:10.450738 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:10.450706    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:12.461019 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:12.460987    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"]
Nov 04 06:10:12.581149 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:12.581119    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"]
Nov 04 06:10:12.858687 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:12.858654    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:13.058459 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:13.058421    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:13.327321 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:13.327239    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:10:14.615125 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:14.615090    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:15.209303 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:15.209144    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8" podUID="66548d55-cc35-4fcf-9dce-38de6915747e" containerName="main" containerID="cri-o://ed6b8b1749627f46b49c24dc9e01514ffcedf110d40a4027c643d0dce9bb13ab" gracePeriod=45
Nov 04 06:10:15.266154 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:15.265391    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x" podUID="3a6a626b-174f-44ac-9618-ae8dcbc568eb" containerName="main" containerID="cri-o://5f9dd8cc8d0ee5fea7ec57e3bdf225551a62c3f9465de1289bd29f26ac386351" gracePeriod=45
Nov 04 06:10:15.334922 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:15.333975    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:15.641914 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:15.622210    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:16.046271 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.038224    4497 generic.go:356] "Generic (PLEG): container finished" podID="3a6a626b-174f-44ac-9618-ae8dcbc568eb" containerID="5f9dd8cc8d0ee5fea7ec57e3bdf225551a62c3f9465de1289bd29f26ac386351" exitCode=0
Nov 04 06:10:16.046271 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.038343    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x" event={"ID":"3a6a626b-174f-44ac-9618-ae8dcbc568eb","Type":"ContainerDied","Data":"5f9dd8cc8d0ee5fea7ec57e3bdf225551a62c3f9465de1289bd29f26ac386351"}
Nov 04 06:10:16.082248 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.082083    4497 generic.go:356] "Generic (PLEG): container finished" podID="66548d55-cc35-4fcf-9dce-38de6915747e" containerID="ed6b8b1749627f46b49c24dc9e01514ffcedf110d40a4027c643d0dce9bb13ab" exitCode=0
Nov 04 06:10:16.082248 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.082170    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8" event={"ID":"66548d55-cc35-4fcf-9dce-38de6915747e","Type":"ContainerDied","Data":"ed6b8b1749627f46b49c24dc9e01514ffcedf110d40a4027c643d0dce9bb13ab"}
Nov 04 06:10:16.083163 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.083115    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:16.178913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.152271    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:10:16.282089 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.281283    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-dshm\") pod \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") "
Nov 04 06:10:16.282089 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.281339    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tls-certs\") pod \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") "
Nov 04 06:10:16.282089 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.281369    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-home\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-home\") pod \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") "
Nov 04 06:10:16.282089 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.281422    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tmp-dir\") pod \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") "
Nov 04 06:10:16.282089 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.281502    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a6a626b-174f-44ac-9618-ae8dcbc568eb-kube-api-access-926hx\" (UniqueName: \"kubernetes.io/projected/3a6a626b-174f-44ac-9618-ae8dcbc568eb-kube-api-access-926hx\") pod \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") "
Nov 04 06:10:16.282089 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.281552    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-model-cache\") pod \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\" (UID: \"3a6a626b-174f-44ac-9618-ae8dcbc568eb\") "
Nov 04 06:10:16.282963 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.282628    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-model-cache" pod "3a6a626b-174f-44ac-9618-ae8dcbc568eb" (UID: "3a6a626b-174f-44ac-9618-ae8dcbc568eb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:16.294267 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.294238    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-home" pod "3a6a626b-174f-44ac-9618-ae8dcbc568eb" (UID: "3a6a626b-174f-44ac-9618-ae8dcbc568eb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:16.302041 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.301615    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:16.351965 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.350391    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tls-certs" pod "3a6a626b-174f-44ac-9618-ae8dcbc568eb" (UID: "3a6a626b-174f-44ac-9618-ae8dcbc568eb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:10:16.352358 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.352282    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tmp-dir" pod "3a6a626b-174f-44ac-9618-ae8dcbc568eb" (UID: "3a6a626b-174f-44ac-9618-ae8dcbc568eb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:16.389992 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.383758    4497 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tmp-dir\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.389992 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.383802    4497 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-model-cache\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.389992 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.383818    4497 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6a626b-174f-44ac-9618-ae8dcbc568eb-tls-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.389992 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.384083    4497 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-home\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.389992 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.384225    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6a626b-174f-44ac-9618-ae8dcbc568eb-kube-api-access-926hx" pod "3a6a626b-174f-44ac-9618-ae8dcbc568eb" (UID: "3a6a626b-174f-44ac-9618-ae8dcbc568eb"). InnerVolumeSpecName "kube-api-access-926hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:16.541562 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.541473    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-dshm" pod "3a6a626b-174f-44ac-9618-ae8dcbc568eb" (UID: "3a6a626b-174f-44ac-9618-ae8dcbc568eb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:16.550955 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.550517    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-926hx\" (UniqueName: \"kubernetes.io/projected/3a6a626b-174f-44ac-9618-ae8dcbc568eb-kube-api-access-926hx\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.559915 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.556247    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:10:16.653913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.652102    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-model-cache\") pod \"66548d55-cc35-4fcf-9dce-38de6915747e\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") "
Nov 04 06:10:16.653913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.652193    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66548d55-cc35-4fcf-9dce-38de6915747e-tls-certs\" (UniqueName: \"kubernetes.io/secret/66548d55-cc35-4fcf-9dce-38de6915747e-tls-certs\") pod \"66548d55-cc35-4fcf-9dce-38de6915747e\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") "
Nov 04 06:10:16.653913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.652319    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-dshm\") pod \"66548d55-cc35-4fcf-9dce-38de6915747e\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") "
Nov 04 06:10:16.653913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.652349    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-home\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-home\") pod \"66548d55-cc35-4fcf-9dce-38de6915747e\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") "
Nov 04 06:10:16.653913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.652410    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-tmp-dir\") pod \"66548d55-cc35-4fcf-9dce-38de6915747e\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") "
Nov 04 06:10:16.653913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.652445    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66548d55-cc35-4fcf-9dce-38de6915747e-kube-api-access-nknd8\" (UniqueName: \"kubernetes.io/projected/66548d55-cc35-4fcf-9dce-38de6915747e-kube-api-access-nknd8\") pod \"66548d55-cc35-4fcf-9dce-38de6915747e\" (UID: \"66548d55-cc35-4fcf-9dce-38de6915747e\") "
Nov 04 06:10:16.653913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.652812    4497 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6a626b-174f-44ac-9618-ae8dcbc568eb-dshm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.653913 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.653761    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-tmp-dir" pod "66548d55-cc35-4fcf-9dce-38de6915747e" (UID: "66548d55-cc35-4fcf-9dce-38de6915747e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:16.654776 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.654142    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-model-cache" pod "66548d55-cc35-4fcf-9dce-38de6915747e" (UID: "66548d55-cc35-4fcf-9dce-38de6915747e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:16.654776 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.654211    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-home" pod "66548d55-cc35-4fcf-9dce-38de6915747e" (UID: "66548d55-cc35-4fcf-9dce-38de6915747e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:16.679107 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.679033    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66548d55-cc35-4fcf-9dce-38de6915747e-kube-api-access-nknd8" pod "66548d55-cc35-4fcf-9dce-38de6915747e" (UID: "66548d55-cc35-4fcf-9dce-38de6915747e"). InnerVolumeSpecName "kube-api-access-nknd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:16.690485 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.690138    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x" podUID="3a6a626b-174f-44ac-9618-ae8dcbc568eb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 04 06:10:16.716608 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.716480    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-dshm" pod "66548d55-cc35-4fcf-9dce-38de6915747e" (UID: "66548d55-cc35-4fcf-9dce-38de6915747e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:16.716608 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.716568    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66548d55-cc35-4fcf-9dce-38de6915747e-tls-certs" pod "66548d55-cc35-4fcf-9dce-38de6915747e" (UID: "66548d55-cc35-4fcf-9dce-38de6915747e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:10:16.757909 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.756866    4497 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-dshm\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.757909 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.756924    4497 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-home\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.757909 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.756940    4497 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-tmp-dir\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.757909 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.756954    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nknd8\" (UniqueName: \"kubernetes.io/projected/66548d55-cc35-4fcf-9dce-38de6915747e-kube-api-access-nknd8\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.757909 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.756970    4497 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66548d55-cc35-4fcf-9dce-38de6915747e-model-cache\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.757909 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.756984    4497 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66548d55-cc35-4fcf-9dce-38de6915747e-tls-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:16.997165 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:16.997114    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8" podUID="66548d55-cc35-4fcf-9dce-38de6915747e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 06:10:17.089050 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.089013    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x" event={"ID":"3a6a626b-174f-44ac-9618-ae8dcbc568eb","Type":"ContainerDied","Data":"bdb89ebccdcb112350822389708714c189cefe98f70f69928d8a4c437b344ed0"}
Nov 04 06:10:17.089244 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.089059    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"
Nov 04 06:10:17.089244 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.089074    4497 scope.go:122] "RemoveContainer" containerID="5f9dd8cc8d0ee5fea7ec57e3bdf225551a62c3f9465de1289bd29f26ac386351"
Nov 04 06:10:17.090636 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.090387    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"
Nov 04 06:10:17.090636 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.090428    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8" event={"ID":"66548d55-cc35-4fcf-9dce-38de6915747e","Type":"ContainerDied","Data":"c314c4671f5f2135166c3c7aa8370065f8960372e675f3182fa8bc7241caeedd"}
Nov 04 06:10:17.101108 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.101036    4497 scope.go:122] "RemoveContainer" containerID="ed6b8b1749627f46b49c24dc9e01514ffcedf110d40a4027c643d0dce9bb13ab"
Nov 04 06:10:17.264338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.264301    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"]
Nov 04 06:10:17.315526 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.315484    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/simulator-w2-db31ef-kserve-86f6f4d4db-5ps7x"]
Nov 04 06:10:17.376803 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.376765    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"]
Nov 04 06:10:17.377284 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377265    4497 cpu_manager.go:414] "containerMap: removing container" podUID="16268c2b-9813-4248-87cf-77890439be44" containerName="maas-api"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377287    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16268c2b-9813-4248-87cf-77890439be44" containerName="maas-api"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377301    4497 cpu_manager.go:414] "containerMap: removing container" podUID="8588c85a-f6fb-49a0-8bbb-27648a5310fa" containerName="main"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377307    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8588c85a-f6fb-49a0-8bbb-27648a5310fa" containerName="main"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377328    4497 cpu_manager.go:414] "containerMap: removing container" podUID="66548d55-cc35-4fcf-9dce-38de6915747e" containerName="main"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377335    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66548d55-cc35-4fcf-9dce-38de6915747e" containerName="main"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377351    4497 cpu_manager.go:414] "containerMap: removing container" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerName="istio-proxy"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377358    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerName="istio-proxy"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377376    4497 cpu_manager.go:414] "containerMap: removing container" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy"
Nov 04 06:10:17.377389 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377383    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377393    4497 cpu_manager.go:414] "containerMap: removing container" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377405    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377415    4497 cpu_manager.go:414] "containerMap: removing container" podUID="3a6a626b-174f-44ac-9618-ae8dcbc568eb" containerName="main"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377423    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a6a626b-174f-44ac-9618-ae8dcbc568eb" containerName="main"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377432    4497 cpu_manager.go:414] "containerMap: removing container" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377439    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377545    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="16268c2b-9813-4248-87cf-77890439be44" containerName="maas-api"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377558    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="8588c85a-f6fb-49a0-8bbb-27648a5310fa" containerName="main"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377568    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="66548d55-cc35-4fcf-9dce-38de6915747e" containerName="main"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377577    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2af72df-6063-4b3b-975d-90c5fddcc403" containerName="istio-proxy"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377586    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377594    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="d102d6b7-9522-4824-a62b-7817609622ee" containerName="istio-proxy"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377603    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a6a626b-174f-44ac-9618-ae8dcbc568eb" containerName="main"
Nov 04 06:10:17.377823 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.377611    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a5136f4-fe72-4211-9b46-bc833adc39a3" containerName="istio-proxy"
Nov 04 06:10:17.382449 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.382425    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.394151 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.394128    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"]
Nov 04 06:10:17.399279 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.399256    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/distinct-w2-db31ef-kserve-5d987cf5d-659f8"]
Nov 04 06:10:17.446404 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.446370    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"]
Nov 04 06:10:17.461377 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.461308    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z" podUID="22879491-6f66-45bd-82e0-2c5266d39bc8" containerName="payload-processing" containerID="cri-o://bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee" gracePeriod=25
Nov 04 06:10:17.465901 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.465857    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.466022 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.466000    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.466087 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.466047    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.466139 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.466086    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.466228 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.466202    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.466302 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.466279    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.466366 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.466349    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7n54\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-kube-api-access-q7n54\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.466423 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.466405    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.466470 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.466454    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.567309 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567213    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.567309 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567296    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.567506 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567347    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.567506 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567387    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.567506 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567426    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.567506 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567459    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.567761 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567524    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.567937 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567879    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.568061 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567942    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.568061 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.567993    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.568283 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.568258    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.568538 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.568307    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7n54\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-kube-api-access-q7n54\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.568538 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.568347    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.568779 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.568754    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.573487 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.570164    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.573487 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.570388    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.581863 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.581762    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf" podUID="543d73c4-a235-4f9e-8097-924960b6cb8e" containerName="payload-pre-processing" containerID="cri-o://d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572" gracePeriod=25
Nov 04 06:10:17.634301 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.634268    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.635049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.635021    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7n54\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-kube-api-access-q7n54\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.697092 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.697053    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:17.710120 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.710093    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:10:17.770119 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.769539    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22879491-6f66-45bd-82e0-2c5266d39bc8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22879491-6f66-45bd-82e0-2c5266d39bc8-plugins-config-volume\") pod \"22879491-6f66-45bd-82e0-2c5266d39bc8\" (UID: \"22879491-6f66-45bd-82e0-2c5266d39bc8\") "
Nov 04 06:10:17.770119 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.769630    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22879491-6f66-45bd-82e0-2c5266d39bc8-kube-api-access-gxjnn\" (UniqueName: \"kubernetes.io/projected/22879491-6f66-45bd-82e0-2c5266d39bc8-kube-api-access-gxjnn\") pod \"22879491-6f66-45bd-82e0-2c5266d39bc8\" (UID: \"22879491-6f66-45bd-82e0-2c5266d39bc8\") "
Nov 04 06:10:17.770119 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.770040    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22879491-6f66-45bd-82e0-2c5266d39bc8-plugins-config-volume" pod "22879491-6f66-45bd-82e0-2c5266d39bc8" (UID: "22879491-6f66-45bd-82e0-2c5266d39bc8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:17.772817 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.772790    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22879491-6f66-45bd-82e0-2c5266d39bc8-kube-api-access-gxjnn" pod "22879491-6f66-45bd-82e0-2c5266d39bc8" (UID: "22879491-6f66-45bd-82e0-2c5266d39bc8"). InnerVolumeSpecName "kube-api-access-gxjnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:17.870716 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.870683    4497 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22879491-6f66-45bd-82e0-2c5266d39bc8-plugins-config-volume\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:17.870716 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:17.870710    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxjnn\" (UniqueName: \"kubernetes.io/projected/22879491-6f66-45bd-82e0-2c5266d39bc8-kube-api-access-gxjnn\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:18.099079 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.099045    4497 generic.go:356] "Generic (PLEG): container finished" podID="22879491-6f66-45bd-82e0-2c5266d39bc8" containerID="bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee" exitCode=0
Nov 04 06:10:18.099238 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.099098    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z" event={"ID":"22879491-6f66-45bd-82e0-2c5266d39bc8","Type":"ContainerDied","Data":"bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee"}
Nov 04 06:10:18.099238 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.099112    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"
Nov 04 06:10:18.099238 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.099161    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z" event={"ID":"22879491-6f66-45bd-82e0-2c5266d39bc8","Type":"ContainerDied","Data":"d3b14df00d2a5e327a56ebf537ab653271f5bc2798bef6bd69457970092a40c4"}
Nov 04 06:10:18.099238 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.099185    4497 scope.go:122] "RemoveContainer" containerID="bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee"
Nov 04 06:10:18.107338 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.107319    4497 scope.go:122] "RemoveContainer" containerID="bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee"
Nov 04 06:10:18.107605 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:18.107582    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee\": container with ID starting with bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee not found: ID does not exist" containerID="bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee"
Nov 04 06:10:18.107663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.107617    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee"} err="failed to get container status \"bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee\": rpc error: code = NotFound desc = could not find container \"bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee\": container with ID starting with bf38f54d898c5bd8b115818d80484ae73aa0ec565d17477a6bba8d38a080ceee not found: ID does not exist"
Nov 04 06:10:18.142310 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.142228    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"]
Nov 04 06:10:18.145628 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:10:18.145604    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d899be5_9297_49fb_8cd1_f6db3f3f5617.slice/crio-832bb0dff1d44611c009b262409021dd4752c1c7dbd03c89e2a73db6dd25355b WatchSource:0}: Error finding container 832bb0dff1d44611c009b262409021dd4752c1c7dbd03c89e2a73db6dd25355b: Status 404 returned error can't find the container with id 832bb0dff1d44611c009b262409021dd4752c1c7dbd03c89e2a73db6dd25355b
Nov 04 06:10:18.148355 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.148320    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:10:18.148437 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.148393    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:10:18.148437 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.148423    4497 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892016Ki","pods":"250"}
Nov 04 06:10:18.213771 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.213732    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a6a626b-174f-44ac-9618-ae8dcbc568eb" path="/var/lib/kubelet/pods/3a6a626b-174f-44ac-9618-ae8dcbc568eb/volumes"
Nov 04 06:10:18.214250 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.214232    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66548d55-cc35-4fcf-9dce-38de6915747e" path="/var/lib/kubelet/pods/66548d55-cc35-4fcf-9dce-38de6915747e/volumes"
Nov 04 06:10:18.271809 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.271773    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"]
Nov 04 06:10:18.275927 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:18.275878    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z"]
Nov 04 06:10:19.127303 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:19.127263    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" event={"ID":"5d899be5-9297-49fb-8cd1-f6db3f3f5617","Type":"ContainerStarted","Data":"9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6"}
Nov 04 06:10:19.127303 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:19.127313    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" event={"ID":"5d899be5-9297-49fb-8cd1-f6db3f3f5617","Type":"ContainerStarted","Data":"832bb0dff1d44611c009b262409021dd4752c1c7dbd03c89e2a73db6dd25355b"}
Nov 04 06:10:19.375279 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:19.375224    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" podStartSLOduration=2.375208158 podStartE2EDuration="2.375208158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:10:19.321401029 +0000 UTC m=+1267.252598427" watchObservedRunningTime="2026-11-04 06:10:19.375208158 +0000 UTC m=+1267.306405555"
Nov 04 06:10:19.697484 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:19.697451    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:19.718911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:19.712099    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 06:10:19.718911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:19.712161    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 06:10:20.219588 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:20.219538    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:20.227993 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:20.227968    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22879491-6f66-45bd-82e0-2c5266d39bc8" path="/var/lib/kubelet/pods/22879491-6f66-45bd-82e0-2c5266d39bc8/volumes"
Nov 04 06:10:20.699921 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:20.697939    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 06:10:20.699921 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:20.698004    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 06:10:21.095348 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:21.095317    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:21.708415 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:21.708381    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 06:10:21.709051 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:21.709007    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 06:10:21.875779 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:21.875734    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:22.123736 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:22.123697    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf" podUID="543d73c4-a235-4f9e-8097-924960b6cb8e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 06:10:22.583810 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:22.583711    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:22.721911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:22.721011    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 06:10:22.721911 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:22.721076    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 06:10:22.732241 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:22.732213    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:23.698316 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:23.698278    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 06:10:23.698602 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:23.698571    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 06:10:24.697682 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:24.697636    4497 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 06:10:24.698244 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:24.697689    4497 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 06:10:24.783163 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:24.783130    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"]
Nov 04 06:10:24.783374 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:24.783322    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd" podUID="55487ae5-28ae-42a8-b08b-fd8153daa6af" containerName="maas-api" containerID="cri-o://eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310" gracePeriod=30
Nov 04 06:10:24.883003 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:24.882971    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:25.701519 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:25.701489    4497 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:25.702011 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:25.701772    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:25.702453 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:25.702439    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:25.988148 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:25.988115    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"]
Nov 04 06:10:25.988417 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:25.988368    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h" podUID="677978a9-0d38-49af-8e20-2f622a22661f" containerName="maas-api" containerID="cri-o://c8f9faac817e32908de0f510cf6b0f339668f4d7c0b5c79a81157556e6f3688f" gracePeriod=30
Nov 04 06:10:26.113689 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.113666    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:10:26.132317 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.132289    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:26.169958 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.169927    4497 generic.go:356] "Generic (PLEG): container finished" podID="677978a9-0d38-49af-8e20-2f622a22661f" containerID="c8f9faac817e32908de0f510cf6b0f339668f4d7c0b5c79a81157556e6f3688f" exitCode=0
Nov 04 06:10:26.170079 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.170003    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h" event={"ID":"677978a9-0d38-49af-8e20-2f622a22661f","Type":"ContainerDied","Data":"c8f9faac817e32908de0f510cf6b0f339668f4d7c0b5c79a81157556e6f3688f"}
Nov 04 06:10:26.171423 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.171397    4497 generic.go:356] "Generic (PLEG): container finished" podID="55487ae5-28ae-42a8-b08b-fd8153daa6af" containerID="eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310" exitCode=0
Nov 04 06:10:26.171541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.171448    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"
Nov 04 06:10:26.171541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.171481    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd" event={"ID":"55487ae5-28ae-42a8-b08b-fd8153daa6af","Type":"ContainerDied","Data":"eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310"}
Nov 04 06:10:26.171541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.171534    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd" event={"ID":"55487ae5-28ae-42a8-b08b-fd8153daa6af","Type":"ContainerDied","Data":"740a06c92d13b21a01ab0a7a84b6d7a6960dd81762229c0bfd1c5b9e8ab987be"}
Nov 04 06:10:26.171705 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.171565    4497 scope.go:122] "RemoveContainer" containerID="eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310"
Nov 04 06:10:26.182063 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.181832    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-metrics-certs\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-metrics-certs\") pod \"55487ae5-28ae-42a8-b08b-fd8153daa6af\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") "
Nov 04 06:10:26.182063 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.181976    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55487ae5-28ae-42a8-b08b-fd8153daa6af-kube-api-access-nqxkd\" (UniqueName: \"kubernetes.io/projected/55487ae5-28ae-42a8-b08b-fd8153daa6af-kube-api-access-nqxkd\") pod \"55487ae5-28ae-42a8-b08b-fd8153daa6af\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") "
Nov 04 06:10:26.182063 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.182028    4497 scope.go:122] "RemoveContainer" containerID="eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310"
Nov 04 06:10:26.182063 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.182042    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/55487ae5-28ae-42a8-b08b-fd8153daa6af-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55487ae5-28ae-42a8-b08b-fd8153daa6af-openshift-service-ca\") pod \"55487ae5-28ae-42a8-b08b-fd8153daa6af\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") "
Nov 04 06:10:26.182323 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.182081    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls\") pod \"55487ae5-28ae-42a8-b08b-fd8153daa6af\" (UID: \"55487ae5-28ae-42a8-b08b-fd8153daa6af\") "
Nov 04 06:10:26.182811 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.182786    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55487ae5-28ae-42a8-b08b-fd8153daa6af-openshift-service-ca" pod "55487ae5-28ae-42a8-b08b-fd8153daa6af" (UID: "55487ae5-28ae-42a8-b08b-fd8153daa6af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:26.182964 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:26.182872    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310\": container with ID starting with eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310 not found: ID does not exist" containerID="eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310"
Nov 04 06:10:26.182964 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.182915    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310"} err="failed to get container status \"eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310\": rpc error: code = NotFound desc = could not find container \"eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310\": container with ID starting with eeb502191c3542e0411b1dcc0ab9ebabd74356f1bbc1213a19784e8d08f14310 not found: ID does not exist"
Nov 04 06:10:26.184690 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.184670    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls" pod "55487ae5-28ae-42a8-b08b-fd8153daa6af" (UID: "55487ae5-28ae-42a8-b08b-fd8153daa6af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:10:26.184784 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.184760    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-metrics-certs" pod "55487ae5-28ae-42a8-b08b-fd8153daa6af" (UID: "55487ae5-28ae-42a8-b08b-fd8153daa6af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:10:26.185101 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.185083    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55487ae5-28ae-42a8-b08b-fd8153daa6af-kube-api-access-nqxkd" pod "55487ae5-28ae-42a8-b08b-fd8153daa6af" (UID: "55487ae5-28ae-42a8-b08b-fd8153daa6af"). InnerVolumeSpecName "kube-api-access-nqxkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:26.243007 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.242949    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:10:26.283249 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.283214    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls\") pod \"677978a9-0d38-49af-8e20-2f622a22661f\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") "
Nov 04 06:10:26.283411 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.283394    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/677978a9-0d38-49af-8e20-2f622a22661f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/677978a9-0d38-49af-8e20-2f622a22661f-openshift-service-ca\") pod \"677978a9-0d38-49af-8e20-2f622a22661f\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") "
Nov 04 06:10:26.283450 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.283436    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/677978a9-0d38-49af-8e20-2f622a22661f-kube-api-access-z97kj\" (UniqueName: \"kubernetes.io/projected/677978a9-0d38-49af-8e20-2f622a22661f-kube-api-access-z97kj\") pod \"677978a9-0d38-49af-8e20-2f622a22661f\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") "
Nov 04 06:10:26.283499 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.283485    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-metrics-certs\") pod \"677978a9-0d38-49af-8e20-2f622a22661f\" (UID: \"677978a9-0d38-49af-8e20-2f622a22661f\") "
Nov 04 06:10:26.283787 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.283756    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/677978a9-0d38-49af-8e20-2f622a22661f-openshift-service-ca" pod "677978a9-0d38-49af-8e20-2f622a22661f" (UID: "677978a9-0d38-49af-8e20-2f622a22661f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:26.284073 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.283990    4497 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-maas-api-tls\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:26.284073 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.284012    4497 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55487ae5-28ae-42a8-b08b-fd8153daa6af-metrics-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:26.284073 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.284027    4497 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/677978a9-0d38-49af-8e20-2f622a22661f-openshift-service-ca\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:26.284073 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.284042    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqxkd\" (UniqueName: \"kubernetes.io/projected/55487ae5-28ae-42a8-b08b-fd8153daa6af-kube-api-access-nqxkd\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:26.284073 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.284056    4497 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55487ae5-28ae-42a8-b08b-fd8153daa6af-openshift-service-ca\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:26.285590 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.285561    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls" pod "677978a9-0d38-49af-8e20-2f622a22661f" (UID: "677978a9-0d38-49af-8e20-2f622a22661f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:10:26.285678 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.285589    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/677978a9-0d38-49af-8e20-2f622a22661f-kube-api-access-z97kj" pod "677978a9-0d38-49af-8e20-2f622a22661f" (UID: "677978a9-0d38-49af-8e20-2f622a22661f"). InnerVolumeSpecName "kube-api-access-z97kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:26.286053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.286028    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-metrics-certs" pod "677978a9-0d38-49af-8e20-2f622a22661f" (UID: "677978a9-0d38-49af-8e20-2f622a22661f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 06:10:26.388947 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.385491    4497 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-metrics-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:26.388947 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.385524    4497 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/677978a9-0d38-49af-8e20-2f622a22661f-maas-api-tls\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:26.388947 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.385538    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z97kj\" (UniqueName: \"kubernetes.io/projected/677978a9-0d38-49af-8e20-2f622a22661f-kube-api-access-z97kj\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:26.604061 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.604029    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"]
Nov 04 06:10:26.605547 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.605519    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f38f69-8978fc47-hvfnd"]
Nov 04 06:10:26.954633 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:26.954579    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:27.104080 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:27.104043    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:27.179855 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:27.179762    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h" event={"ID":"677978a9-0d38-49af-8e20-2f622a22661f","Type":"ContainerDied","Data":"ad95d62fb0026b42682051182d257a355937734f4af5ad71f75aca6af660e844"}
Nov 04 06:10:27.180034 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:27.179908    4497 scope.go:122] "RemoveContainer" containerID="c8f9faac817e32908de0f510cf6b0f339668f4d7c0b5c79a81157556e6f3688f"
Nov 04 06:10:27.180034 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:27.179941    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"
Nov 04 06:10:27.352293 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:27.352250    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"]
Nov 04 06:10:27.355669 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:27.355631    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-db31ef-65764558bd-qv45h"]
Nov 04 06:10:27.767918 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:27.767862    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:27.916674 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:27.916643    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:28.212217 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:28.212187    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55487ae5-28ae-42a8-b08b-fd8153daa6af" path="/var/lib/kubelet/pods/55487ae5-28ae-42a8-b08b-fd8153daa6af/volumes"
Nov 04 06:10:28.212630 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:28.212615    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="677978a9-0d38-49af-8e20-2f622a22661f" path="/var/lib/kubelet/pods/677978a9-0d38-49af-8e20-2f622a22661f/volumes"
Nov 04 06:10:28.433804 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:28.433776    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:28.585475 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:28.585379    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:29.458359 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:29.458329    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:29.602685 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:29.602655    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:29.753613 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:29.753519    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:32.110848 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:32.110812    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf" podUID="543d73c4-a235-4f9e-8097-924960b6cb8e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 06:10:32.931244 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:32.931210    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:33.530053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:33.530011    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"]
Nov 04 06:10:33.530561 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:33.530258    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy" containerID="cri-o://d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563" gracePeriod=30
Nov 04 06:10:33.543872 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:33.543843    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"]
Nov 04 06:10:33.544058 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:33.544038    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy" containerID="cri-o://d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b" gracePeriod=30
Nov 04 06:10:33.575628 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:33.575594    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"]
Nov 04 06:10:33.575837 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:33.575800    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy" containerID="cri-o://5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e" gracePeriod=30
Nov 04 06:10:33.598951 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:33.598854    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:35.399591 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:35.399551    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 06:10:35.399997 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:35.399620    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 06:10:35.420763 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:35.420732    4497 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 06:10:35.420932 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:35.420785    4497 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 06:10:35.753668 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:35.753582    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:35.899832 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:35.899787    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:37.851910 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:37.851797    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:10:38.012837 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.012792    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/543d73c4-a235-4f9e-8097-924960b6cb8e-kube-api-access-szmp2\" (UniqueName: \"kubernetes.io/projected/543d73c4-a235-4f9e-8097-924960b6cb8e-kube-api-access-szmp2\") pod \"543d73c4-a235-4f9e-8097-924960b6cb8e\" (UID: \"543d73c4-a235-4f9e-8097-924960b6cb8e\") "
Nov 04 06:10:38.013052 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.012949    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/543d73c4-a235-4f9e-8097-924960b6cb8e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d73c4-a235-4f9e-8097-924960b6cb8e-plugins-config-volume\") pod \"543d73c4-a235-4f9e-8097-924960b6cb8e\" (UID: \"543d73c4-a235-4f9e-8097-924960b6cb8e\") "
Nov 04 06:10:38.013720 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.013678    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543d73c4-a235-4f9e-8097-924960b6cb8e-plugins-config-volume" pod "543d73c4-a235-4f9e-8097-924960b6cb8e" (UID: "543d73c4-a235-4f9e-8097-924960b6cb8e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:38.021598 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.021556    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543d73c4-a235-4f9e-8097-924960b6cb8e-kube-api-access-szmp2" pod "543d73c4-a235-4f9e-8097-924960b6cb8e" (UID: "543d73c4-a235-4f9e-8097-924960b6cb8e"). InnerVolumeSpecName "kube-api-access-szmp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:38.069040 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.068999    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:38.114345 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.114229    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szmp2\" (UniqueName: \"kubernetes.io/projected/543d73c4-a235-4f9e-8097-924960b6cb8e-kube-api-access-szmp2\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:38.114345 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.114271    4497 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543d73c4-a235-4f9e-8097-924960b6cb8e-plugins-config-volume\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:38.233676 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.233641    4497 generic.go:356] "Generic (PLEG): container finished" podID="543d73c4-a235-4f9e-8097-924960b6cb8e" containerID="d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572" exitCode=0
Nov 04 06:10:38.233927 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.233763    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf" event={"ID":"543d73c4-a235-4f9e-8097-924960b6cb8e","Type":"ContainerDied","Data":"d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572"}
Nov 04 06:10:38.233927 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.233816    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf" event={"ID":"543d73c4-a235-4f9e-8097-924960b6cb8e","Type":"ContainerDied","Data":"408ce43757b168a16f1c96484b776bf5a0ff0015d67c0972e144609bc1589275"}
Nov 04 06:10:38.233927 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.233845    4497 scope.go:122] "RemoveContainer" containerID="d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572"
Nov 04 06:10:38.234116 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.234039    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"
Nov 04 06:10:38.239071 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.238960    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:38.249859 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.249827    4497 scope.go:122] "RemoveContainer" containerID="d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572"
Nov 04 06:10:38.251608 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:38.251579    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572\": container with ID starting with d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572 not found: ID does not exist" containerID="d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572"
Nov 04 06:10:38.251739 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.251619    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572"} err="failed to get container status \"d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572\": rpc error: code = NotFound desc = could not find container \"d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572\": container with ID starting with d3a51925fb181279f6f397fb7ad9242244ffbc0ec689e666f2613f65cd685572 not found: ID does not exist"
Nov 04 06:10:38.381706 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.381606    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:38.406464 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.406426    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"]
Nov 04 06:10:38.411126 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.411099    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf"]
Nov 04 06:10:38.863563 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.863533    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:10:38.866485 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.866462    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:10:38.906391 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:38.906362    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:10:39.023541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023447    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-data\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.023541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023492    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-envoy\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.023541 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023515    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-podinfo\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023557    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2ec73258-37f3-4280-b233-59fafcaddef2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec73258-37f3-4280-b233-59fafcaddef2-istio-podinfo\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023587    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-certs\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023627    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-socket\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023662    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ec73258-37f3-4280-b233-59fafcaddef2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec73258-37f3-4280-b233-59fafcaddef2-istiod-ca-cert\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023702    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-kube-api-access-gkrzx\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-kube-api-access-gkrzx\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023729    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-credential-socket\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023758    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-credential-socket\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023784    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-data\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023819    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-token\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-token\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023851    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istiod-ca-cert\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023855    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-data" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023938    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-certs\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023970    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-istio-token\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-istio-token\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.023986    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-certs" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024001    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-credential-socket\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024029    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-kube-api-access-kk74b\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-kube-api-access-kk74b\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024088    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-envoy\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024126    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-data\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024156    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-socket" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024170    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-socket\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024210    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-token\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-token\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024252    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-socket\") pod \"2ec73258-37f3-4280-b233-59fafcaddef2\" (UID: \"2ec73258-37f3-4280-b233-59fafcaddef2\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024326    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-certs\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024373    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-kube-api-access-7z4fw\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-kube-api-access-7z4fw\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024388    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-credential-socket" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024420    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-envoy\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024472    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6b2eecc-b058-45fc-9339-1e4d62da928b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6b2eecc-b058-45fc-9339-1e4d62da928b-istiod-ca-cert\") pod \"a6b2eecc-b058-45fc-9339-1e4d62da928b\" (UID: \"a6b2eecc-b058-45fc-9339-1e4d62da928b\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024570    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-podinfo\") pod \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\" (UID: \"2767f02f-a2e7-4088-809c-b3c4a7c12b8f\") "
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024579    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-credential-socket" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.024754    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-data" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.025048    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.025068    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.025084    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.025099    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.025113    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.025126    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.027646 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.025437    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec73258-37f3-4280-b233-59fafcaddef2-istiod-ca-cert" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.028790    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ec73258-37f3-4280-b233-59fafcaddef2-istio-podinfo" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.028864    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-istio-token" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.028873    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-envoy" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.028913    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-token" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.028876    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-token" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029102    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-credential-socket" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029121    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-podinfo" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029170    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-socket" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029213    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-certs" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029269    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istiod-ca-cert" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029418    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-certs" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029415    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-kube-api-access-gkrzx" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "kube-api-access-gkrzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:39.029546 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029510    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b2eecc-b058-45fc-9339-1e4d62da928b-istiod-ca-cert" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:39.030178 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029652    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-socket" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.030178 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.029758    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-data" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.030178 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.030102    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-podinfo" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:10:39.030934 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.030913    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-kube-api-access-7z4fw" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "kube-api-access-7z4fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:39.031133 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.031114    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-kube-api-access-kk74b" pod "2ec73258-37f3-4280-b233-59fafcaddef2" (UID: "2ec73258-37f3-4280-b233-59fafcaddef2"). InnerVolumeSpecName "kube-api-access-kk74b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:39.031699 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.031683    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-envoy" pod "2767f02f-a2e7-4088-809c-b3c4a7c12b8f" (UID: "2767f02f-a2e7-4088-809c-b3c4a7c12b8f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.031751 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.031703    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-envoy" pod "a6b2eecc-b058-45fc-9339-1e4d62da928b" (UID: "a6b2eecc-b058-45fc-9339-1e4d62da928b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:39.125990 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.125959    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.125990 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.125988    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z4fw\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-kube-api-access-7z4fw\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.125990 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.125997    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126007    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6b2eecc-b058-45fc-9339-1e4d62da928b-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126016    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126026    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126034    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126041    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ec73258-37f3-4280-b233-59fafcaddef2-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126051    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ec73258-37f3-4280-b233-59fafcaddef2-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126061    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkrzx\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-kube-api-access-gkrzx\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126069    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126077    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126087    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126095    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126104    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126112    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk74b\" (UniqueName: \"kubernetes.io/projected/2ec73258-37f3-4280-b233-59fafcaddef2-kube-api-access-kk74b\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126120    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126127    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126135    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6b2eecc-b058-45fc-9339-1e4d62da928b-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126143    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2767f02f-a2e7-4088-809c-b3c4a7c12b8f-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.126216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.126151    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ec73258-37f3-4280-b233-59fafcaddef2-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:39.241227 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.241138    4497 generic.go:356] "Generic (PLEG): container finished" podID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerID="d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b" exitCode=0
Nov 04 06:10:39.241227 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.241187    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" event={"ID":"2767f02f-a2e7-4088-809c-b3c4a7c12b8f","Type":"ContainerDied","Data":"d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b"}
Nov 04 06:10:39.241227 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.241211    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"
Nov 04 06:10:39.241518 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.241245    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2" event={"ID":"2767f02f-a2e7-4088-809c-b3c4a7c12b8f","Type":"ContainerDied","Data":"04a5ed1c2af496bf122f233661630d7cfa6ff3f23f971adb12847c533fd7f844"}
Nov 04 06:10:39.241518 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.241276    4497 scope.go:122] "RemoveContainer" containerID="d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b"
Nov 04 06:10:39.243813 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.243633    4497 generic.go:356] "Generic (PLEG): container finished" podID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerID="5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e" exitCode=0
Nov 04 06:10:39.243813 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.243696    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"
Nov 04 06:10:39.243813 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.243697    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" event={"ID":"a6b2eecc-b058-45fc-9339-1e4d62da928b","Type":"ContainerDied","Data":"5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e"}
Nov 04 06:10:39.243813 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.243776    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m" event={"ID":"a6b2eecc-b058-45fc-9339-1e4d62da928b","Type":"ContainerDied","Data":"d31c6710c6fd07d59cf78c19ceb9a11dd8452e8e524936be8c08864d2aef954c"}
Nov 04 06:10:39.245454 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.245425    4497 generic.go:356] "Generic (PLEG): container finished" podID="2ec73258-37f3-4280-b233-59fafcaddef2" containerID="d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563" exitCode=0
Nov 04 06:10:39.245587 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.245551    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" event={"ID":"2ec73258-37f3-4280-b233-59fafcaddef2","Type":"ContainerDied","Data":"d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563"}
Nov 04 06:10:39.245648 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.245595    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q" event={"ID":"2ec73258-37f3-4280-b233-59fafcaddef2","Type":"ContainerDied","Data":"b68b22147010229ecb852c56f4166b2cb8534c86d6e3678a1e9c968f071b2f33"}
Nov 04 06:10:39.245702 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.245676    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"
Nov 04 06:10:39.251691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.251668    4497 scope.go:122] "RemoveContainer" containerID="d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b"
Nov 04 06:10:39.252090 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:39.252066    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b\": container with ID starting with d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b not found: ID does not exist" containerID="d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b"
Nov 04 06:10:39.252216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.252097    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b"} err="failed to get container status \"d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b\": rpc error: code = NotFound desc = could not find container \"d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b\": container with ID starting with d9586e8855c50d73f9ba7a5bbcde04b7394a4fb56250085034bfe8308e3a744b not found: ID does not exist"
Nov 04 06:10:39.252216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.252115    4497 scope.go:122] "RemoveContainer" containerID="5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e"
Nov 04 06:10:39.263608 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.263581    4497 scope.go:122] "RemoveContainer" containerID="5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e"
Nov 04 06:10:39.263955 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:39.263933    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e\": container with ID starting with 5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e not found: ID does not exist" containerID="5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e"
Nov 04 06:10:39.264053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.263965    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e"} err="failed to get container status \"5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e\": rpc error: code = NotFound desc = could not find container \"5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e\": container with ID starting with 5f45439f203d1aaacbe37627c21d1eec229f729a840d84da29e172d728e9374e not found: ID does not exist"
Nov 04 06:10:39.264053 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.263985    4497 scope.go:122] "RemoveContainer" containerID="d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563"
Nov 04 06:10:39.273493 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.273465    4497 scope.go:122] "RemoveContainer" containerID="d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563"
Nov 04 06:10:39.273872 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:39.273819    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563\": container with ID starting with d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563 not found: ID does not exist" containerID="d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563"
Nov 04 06:10:39.273872 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.273849    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563"} err="failed to get container status \"d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563\": rpc error: code = NotFound desc = could not find container \"d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563\": container with ID starting with d6a75c1d3f2bb0e34b4dd468a5e46a2f590cac9ee7883d43c764800eb4c39563 not found: ID does not exist"
Nov 04 06:10:39.414916 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.414866    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"]
Nov 04 06:10:39.422600 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.422556    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q"]
Nov 04 06:10:39.536964 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.536859    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"]
Nov 04 06:10:39.541145 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.541110    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m"]
Nov 04 06:10:39.656720 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.656681    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"]
Nov 04 06:10:39.662276 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:39.662241    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2"]
Nov 04 06:10:40.212609 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:40.212573    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" path="/var/lib/kubelet/pods/2767f02f-a2e7-4088-809c-b3c4a7c12b8f/volumes"
Nov 04 06:10:40.213025 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:40.213011    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" path="/var/lib/kubelet/pods/2ec73258-37f3-4280-b233-59fafcaddef2/volumes"
Nov 04 06:10:40.213327 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:40.213315    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="543d73c4-a235-4f9e-8097-924960b6cb8e" path="/var/lib/kubelet/pods/543d73c4-a235-4f9e-8097-924960b6cb8e/volumes"
Nov 04 06:10:40.214023 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:40.214009    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" path="/var/lib/kubelet/pods/a6b2eecc-b058-45fc-9339-1e4d62da928b/volumes"
Nov 04 06:10:42.430652 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:42.430613    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:42.944846 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:42.944810    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:42.949513 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:42.949484    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"]
Nov 04 06:10:42.949759 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:42.949720    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy" containerID="cri-o://bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d" gracePeriod=30
Nov 04 06:10:42.959950 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:42.959918    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"]
Nov 04 06:10:42.960165 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:42.960145    4497 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy" containerID="cri-o://9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6" gracePeriod=30
Nov 04 06:10:43.328273 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:43.328180    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:10:44.151045 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:44.151010    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:44.695129 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:44.695093    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9fbdcdcb-6rdbx_b3be3cf5-4661-4e38-8460-230a3f155013/authorino/0.log"
Nov 04 06:10:48.209189 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.209163    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:10:48.237857 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.237834    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:48.294980 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.294947    4497 generic.go:356] "Generic (PLEG): container finished" podID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerID="9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6" exitCode=0
Nov 04 06:10:48.295171 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.295001    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"
Nov 04 06:10:48.295171 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.295037    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" event={"ID":"5d899be5-9297-49fb-8cd1-f6db3f3f5617","Type":"ContainerDied","Data":"9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6"}
Nov 04 06:10:48.295171 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.295092    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc" event={"ID":"5d899be5-9297-49fb-8cd1-f6db3f3f5617","Type":"ContainerDied","Data":"832bb0dff1d44611c009b262409021dd4752c1c7dbd03c89e2a73db6dd25355b"}
Nov 04 06:10:48.295171 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.295122    4497 scope.go:122] "RemoveContainer" containerID="9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6"
Nov 04 06:10:48.296371 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.296350    4497 generic.go:356] "Generic (PLEG): container finished" podID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerID="bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d" exitCode=0
Nov 04 06:10:48.296470 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.296384    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" event={"ID":"649c17e9-7aed-4729-b567-6e3fa8fb931c","Type":"ContainerDied","Data":"bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d"}
Nov 04 06:10:48.296470 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.296398    4497 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"
Nov 04 06:10:48.296470 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.296418    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2" event={"ID":"649c17e9-7aed-4729-b567-6e3fa8fb931c","Type":"ContainerDied","Data":"9c5550fb3c6329f440480fd6e7d52a550963841a1ad85898ba56ed2937536975"}
Nov 04 06:10:48.303690 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.303668    4497 scope.go:122] "RemoveContainer" containerID="9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6"
Nov 04 06:10:48.304003 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:48.303985    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6\": container with ID starting with 9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6 not found: ID does not exist" containerID="9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6"
Nov 04 06:10:48.304049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.304012    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6"} err="failed to get container status \"9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6\": rpc error: code = NotFound desc = could not find container \"9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6\": container with ID starting with 9cab585da64c7b18b02949ac7da6967487881b81fbc8087a79e59fd4e05550b6 not found: ID does not exist"
Nov 04 06:10:48.304049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.304030    4497 scope.go:122] "RemoveContainer" containerID="bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d"
Nov 04 06:10:48.312267 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312246    4497 scope.go:122] "RemoveContainer" containerID="bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d"
Nov 04 06:10:48.312533 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312514    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-kube-api-access-4p9f9\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-kube-api-access-4p9f9\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.312608 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312564    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-podinfo\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.312608 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:10:48.312576    4497 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d\": container with ID starting with bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d not found: ID does not exist" containerID="bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d"
Nov 04 06:10:48.312608 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312601    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-token\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-token\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.312710 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312609    4497 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d"} err="failed to get container status \"bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d\": rpc error: code = NotFound desc = could not find container \"bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d\": container with ID starting with bca7414fcdc475035e0bf3d494e89c66255a69509097cd37e5bc67973f7d0b5d not found: ID does not exist"
Nov 04 06:10:48.312710 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312656    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/649c17e9-7aed-4729-b567-6e3fa8fb931c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649c17e9-7aed-4729-b567-6e3fa8fb931c-istiod-ca-cert\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.312710 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312693    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-socket\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.312821 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312721    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-certs\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.312821 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312754    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-data\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.312821 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312798    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-envoy\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.312951 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.312838    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-credential-socket\") pod \"649c17e9-7aed-4729-b567-6e3fa8fb931c\" (UID: \"649c17e9-7aed-4729-b567-6e3fa8fb931c\") "
Nov 04 06:10:48.313167 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.313144    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/649c17e9-7aed-4729-b567-6e3fa8fb931c-istiod-ca-cert" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:48.313360 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.313342    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-credential-socket" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.313524 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.313494    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-socket" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.313616 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.313568    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-data" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.313656 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.313610    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-certs" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.314967 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.314945    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-podinfo" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:10:48.315252 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.315228    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-kube-api-access-4p9f9" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "kube-api-access-4p9f9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:48.315252 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.315247    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-token" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:48.315380 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.315250    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-envoy" pod "649c17e9-7aed-4729-b567-6e3fa8fb931c" (UID: "649c17e9-7aed-4729-b567-6e3fa8fb931c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.414188 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414151    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-certs\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414408 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414214    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-data\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414408 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414251    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-podinfo\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414408 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414323    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-credential-socket\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414408 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414359    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istiod-ca-cert\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414408 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414396    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-socket\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414448    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-kube-api-access-q7n54\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-kube-api-access-q7n54\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414483    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-token\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-token\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414515    4497 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-envoy\") pod \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\" (UID: \"5d899be5-9297-49fb-8cd1-f6db3f3f5617\") "
Nov 04 06:10:48.414663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414541    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-data" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.414663 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414566    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-certs" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.414929 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414676    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-credential-socket" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.414929 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414812    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-socket" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.414929 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.414842    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istiod-ca-cert" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 06:10:48.415638 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415604    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.415763 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415647    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.415763 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415666    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649c17e9-7aed-4729-b567-6e3fa8fb931c-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.415763 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415683    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.415763 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415708    4497 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-workload-certs\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.416008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415724    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.416008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415819    4497 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-data\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.416008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415833    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.416008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415852    4497 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-workload-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.416008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415867    4497 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649c17e9-7aed-4729-b567-6e3fa8fb931c-credential-socket\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.416008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415900    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p9f9\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-kube-api-access-4p9f9\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.416008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415928    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.416008 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.415950    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/649c17e9-7aed-4729-b567-6e3fa8fb931c-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.422815 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.416997    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-podinfo" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 06:10:48.423367 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.423338    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-envoy" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 06:10:48.423367 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.423355    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-token" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:48.424193 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.424175    4497 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-kube-api-access-q7n54" pod "5d899be5-9297-49fb-8cd1-f6db3f3f5617" (UID: "5d899be5-9297-49fb-8cd1-f6db3f3f5617"). InnerVolumeSpecName "kube-api-access-q7n54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 06:10:48.517538 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.517440    4497 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-podinfo\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.517538 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.517478    4497 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istiod-ca-cert\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.517538 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.517492    4497 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7n54\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-kube-api-access-q7n54\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.517538 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.517507    4497 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-token\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.517538 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.517519    4497 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d899be5-9297-49fb-8cd1-f6db3f3f5617-istio-envoy\") on node \"ip-10-0-143-195.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 06:10:48.723789 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.723757    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"]
Nov 04 06:10:48.727797 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.727772    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc"]
Nov 04 06:10:48.841761 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.841721    4497 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"]
Nov 04 06:10:48.845981 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:48.845954    4497 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2"]
Nov 04 06:10:50.211290 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:50.211254    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" path="/var/lib/kubelet/pods/5d899be5-9297-49fb-8cd1-f6db3f3f5617/volumes"
Nov 04 06:10:50.211676 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:50.211666    4497 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" path="/var/lib/kubelet/pods/649c17e9-7aed-4729-b567-6e3fa8fb931c/volumes"
Nov 04 06:10:58.887758 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:58.887677    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:59.039058 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:59.039024    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:10:59.993166 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:10:59.993130    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67c499f7d4-2t8s7_093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8/maas-api/0.log"
Nov 04 06:11:01.964760 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:01.964721    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:11:02.112394 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:02.112356    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:11:05.427129 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:05.427092    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9fbdcdcb-6rdbx_b3be3cf5-4661-4e38-8460-230a3f155013/authorino/0.log"
Nov 04 06:11:09.046806 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:09.046775    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8546cb5f-crt7k_2684e9a5-c202-4312-ae39-375c64ceccda/kube-auth-proxy/0.log"
Nov 04 06:11:09.500270 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:09.500240    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-l4lrf_beed461d-3e44-4d7e-9e36-75754374a6d6/istio-proxy/0.log"
Nov 04 06:11:10.059722 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:10.059685    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:11:11.404948 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:11.404905    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b_3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4/main/0.log"
Nov 04 06:11:11.627453 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:11.627412    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-5jdsl_ca4fcb96-5873-4ebf-9d46-d4a172b87dd6/main/0.log"
Nov 04 06:11:11.867761 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:11.867728    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-w58t4_1f87ac85-479a-4c14-a97a-197828636993/main/0.log"
Nov 04 06:11:12.095219 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:12.095184    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-8kgn6_0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0/main/0.log"
Nov 04 06:11:12.573954 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:12.573920    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-4dhmf_e875963a-1a5a-43d6-8d42-fc6fac17faba/main/0.log"
Nov 04 06:11:12.804878 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:12.804783    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k_870db804-0c00-469c-bdba-4af50f4d8553/main/0.log"
Nov 04 06:11:13.032207 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:13.032178    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw_ce58927f-8cf1-4e45-8b58-c28d9f6f7210/main/0.log"
Nov 04 06:11:13.328069 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:11:13.328030    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:11:14.189615 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:14.189579    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9fbdcdcb-6rdbx_b3be3cf5-4661-4e38-8460-230a3f155013/authorino/0.log"
Nov 04 06:11:25.451017 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:25.450979    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67c499f7d4-2t8s7_093289d7-c9c6-4bba-9c4a-d1e5d1a96bb8/maas-api/0.log"
Nov 04 06:11:29.923278 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:29.923239    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9fbdcdcb-6rdbx_b3be3cf5-4661-4e38-8460-230a3f155013/authorino/0.log"
Nov 04 06:11:32.726043 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:32.726012    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8546cb5f-crt7k_2684e9a5-c202-4312-ae39-375c64ceccda/kube-auth-proxy/0.log"
Nov 04 06:11:33.192473 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:33.192444    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-l4lrf_beed461d-3e44-4d7e-9e36-75754374a6d6/istio-proxy/0.log"
Nov 04 06:11:34.689196 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:34.689159    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-zwr4b_3fba1c47-0cd7-4bfa-a5fa-57b5da8949c4/main/0.log"
Nov 04 06:11:34.915947 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:34.915915    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-5jdsl_ca4fcb96-5873-4ebf-9d46-d4a172b87dd6/main/0.log"
Nov 04 06:11:35.136937 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:35.136905    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-w58t4_1f87ac85-479a-4c14-a97a-197828636993/main/0.log"
Nov 04 06:11:35.357322 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:35.357282    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-8kgn6_0f34c51b-c9bd-4fce-a2c4-aeeab972d3d0/main/0.log"
Nov 04 06:11:35.799306 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:35.799265    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-4dhmf_e875963a-1a5a-43d6-8d42-fc6fac17faba/main/0.log"
Nov 04 06:11:36.029127 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:36.029095    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-z4n5k_870db804-0c00-469c-bdba-4af50f4d8553/main/0.log"
Nov 04 06:11:36.249623 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:11:36.249594    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-xd9tw_ce58927f-8cf1-4e45-8b58-c28d9f6f7210/main/0.log"
Nov 04 06:11:43.327460 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:11:43.327417    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:12:10.475153 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:10.475108    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:12:13.328132 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:12:13.328093    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:12:15.210736 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:15.210700    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:12:15.356726 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:15.356689    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:12:31.746640 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746560    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ntc6w/must-gather-rxnts"]
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746902    4497 cpu_manager.go:414] "containerMap: removing container" podUID="677978a9-0d38-49af-8e20-2f622a22661f" containerName="maas-api"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746914    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="677978a9-0d38-49af-8e20-2f622a22661f" containerName="maas-api"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746923    4497 cpu_manager.go:414] "containerMap: removing container" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746929    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746941    4497 cpu_manager.go:414] "containerMap: removing container" podUID="55487ae5-28ae-42a8-b08b-fd8153daa6af" containerName="maas-api"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746946    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55487ae5-28ae-42a8-b08b-fd8153daa6af" containerName="maas-api"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746956    4497 cpu_manager.go:414] "containerMap: removing container" podUID="543d73c4-a235-4f9e-8097-924960b6cb8e" containerName="payload-pre-processing"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746960    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="543d73c4-a235-4f9e-8097-924960b6cb8e" containerName="payload-pre-processing"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746967    4497 cpu_manager.go:414] "containerMap: removing container" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746971    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746982    4497 cpu_manager.go:414] "containerMap: removing container" podUID="22879491-6f66-45bd-82e0-2c5266d39bc8" containerName="payload-processing"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.746987    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22879491-6f66-45bd-82e0-2c5266d39bc8" containerName="payload-processing"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747008    4497 cpu_manager.go:414] "containerMap: removing container" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747013    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747025    4497 cpu_manager.go:414] "containerMap: removing container" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747030    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747041    4497 cpu_manager.go:414] "containerMap: removing container" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy"
Nov 04 06:12:31.747049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747046    4497 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747100    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="22879491-6f66-45bd-82e0-2c5266d39bc8" containerName="payload-processing"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747109    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d899be5-9297-49fb-8cd1-f6db3f3f5617" containerName="istio-proxy"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747115    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6b2eecc-b058-45fc-9339-1e4d62da928b" containerName="istio-proxy"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747121    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="2767f02f-a2e7-4088-809c-b3c4a7c12b8f" containerName="istio-proxy"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747128    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="677978a9-0d38-49af-8e20-2f622a22661f" containerName="maas-api"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747133    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="649c17e9-7aed-4729-b567-6e3fa8fb931c" containerName="istio-proxy"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747140    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="55487ae5-28ae-42a8-b08b-fd8153daa6af" containerName="maas-api"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747146    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="543d73c4-a235-4f9e-8097-924960b6cb8e" containerName="payload-pre-processing"
Nov 04 06:12:31.747691 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.747151    4497 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ec73258-37f3-4280-b233-59fafcaddef2" containerName="istio-proxy"
Nov 04 06:12:31.749979 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.749962    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntc6w/must-gather-rxnts"
Nov 04 06:12:31.763897 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.763864    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f3705a50-a083-4eb9-af86-b996bc953b9a-must-gather-output\") pod \"must-gather-rxnts\" (UID: \"f3705a50-a083-4eb9-af86-b996bc953b9a\") " pod="openshift-must-gather-ntc6w/must-gather-rxnts"
Nov 04 06:12:31.764012 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.763985    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77fvc\" (UniqueName: \"kubernetes.io/projected/f3705a50-a083-4eb9-af86-b996bc953b9a-kube-api-access-77fvc\") pod \"must-gather-rxnts\" (UID: \"f3705a50-a083-4eb9-af86-b996bc953b9a\") " pod="openshift-must-gather-ntc6w/must-gather-rxnts"
Nov 04 06:12:31.804952 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.804928    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntc6w\"/\"openshift-service-ca.crt\""
Nov 04 06:12:31.805065 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.804930    4497 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntc6w\"/\"kube-root-ca.crt\""
Nov 04 06:12:31.857445 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.857417    4497 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ntc6w\"/\"default-dockercfg-pqhfh\""
Nov 04 06:12:31.858827 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.858806    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntc6w/must-gather-rxnts"]
Nov 04 06:12:31.864779 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.864760    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f3705a50-a083-4eb9-af86-b996bc953b9a-must-gather-output\") pod \"must-gather-rxnts\" (UID: \"f3705a50-a083-4eb9-af86-b996bc953b9a\") " pod="openshift-must-gather-ntc6w/must-gather-rxnts"
Nov 04 06:12:31.864852 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.864823    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77fvc\" (UniqueName: \"kubernetes.io/projected/f3705a50-a083-4eb9-af86-b996bc953b9a-kube-api-access-77fvc\") pod \"must-gather-rxnts\" (UID: \"f3705a50-a083-4eb9-af86-b996bc953b9a\") " pod="openshift-must-gather-ntc6w/must-gather-rxnts"
Nov 04 06:12:31.865110 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.865093    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f3705a50-a083-4eb9-af86-b996bc953b9a-must-gather-output\") pod \"must-gather-rxnts\" (UID: \"f3705a50-a083-4eb9-af86-b996bc953b9a\") " pod="openshift-must-gather-ntc6w/must-gather-rxnts"
Nov 04 06:12:31.928327 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:31.928291    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77fvc\" (UniqueName: \"kubernetes.io/projected/f3705a50-a083-4eb9-af86-b996bc953b9a-kube-api-access-77fvc\") pod \"must-gather-rxnts\" (UID: \"f3705a50-a083-4eb9-af86-b996bc953b9a\") " pod="openshift-must-gather-ntc6w/must-gather-rxnts"
Nov 04 06:12:32.063154 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:32.063073    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntc6w/must-gather-rxnts"
Nov 04 06:12:32.445030 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:32.444992    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntc6w/must-gather-rxnts"]
Nov 04 06:12:32.448703 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:12:32.448676    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3705a50_a083_4eb9_af86_b996bc953b9a.slice/crio-d0ba93cb4bc785f900634185350b46c38ba81c4cb38ee37a0d24e2713232b1a8 WatchSource:0}: Error finding container d0ba93cb4bc785f900634185350b46c38ba81c4cb38ee37a0d24e2713232b1a8: Status 404 returned error can't find the container with id d0ba93cb4bc785f900634185350b46c38ba81c4cb38ee37a0d24e2713232b1a8
Nov 04 06:12:32.766495 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:32.766407    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/must-gather-rxnts" event={"ID":"f3705a50-a083-4eb9-af86-b996bc953b9a","Type":"ContainerStarted","Data":"d0ba93cb4bc785f900634185350b46c38ba81c4cb38ee37a0d24e2713232b1a8"}
Nov 04 06:12:33.161721 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:33.161686    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:12:33.306319 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:33.306286    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:12:34.776791 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:34.776756    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/must-gather-rxnts" event={"ID":"f3705a50-a083-4eb9-af86-b996bc953b9a","Type":"ContainerStarted","Data":"398b1169995ef9249f60e215fb35e326a6395711c571c6ded15705236b4507d9"}
Nov 04 06:12:34.777349 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:34.776801    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/must-gather-rxnts" event={"ID":"f3705a50-a083-4eb9-af86-b996bc953b9a","Type":"ContainerStarted","Data":"115b79fa7c19d34cbe27056826a8318aec03537a388bb11475652d15d634dbd3"}
Nov 04 06:12:34.898242 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:34.898183    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-ntc6w/must-gather-rxnts" podStartSLOduration=2.60847563 podStartE2EDuration="3.898165293s" totalImagesPullingTime="1.289689663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:12:34.896900642 +0000 UTC m=+1402.828098030" watchObservedRunningTime="2026-11-04 06:12:34.898165293 +0000 UTC m=+1402.829362692"
Nov 04 06:12:41.014432 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:41.014400    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-86xkr_4d26948e-8d34-4cd2-bfe6-0702f4965c1b/global-pull-secret-syncer/0.log"
Nov 04 06:12:43.328017 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:12:43.327978    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:12:44.289621 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:44.289595    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log"
Nov 04 06:12:46.509677 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:12:46.509643    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-195.us-west-1.compute.internal_c656c4baa8463ac8d24886e04ca99821/haproxy/0.log"
Nov 04 06:13:00.150969 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:00.150932    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9fbdcdcb-6rdbx_b3be3cf5-4661-4e38-8460-230a3f155013/authorino/0.log"
Nov 04 06:13:03.708012 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.707972    4497 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"]
Nov 04 06:13:03.713497 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.713468    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.809128 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.809075    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"]
Nov 04 06:13:03.876404 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.876370    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-sys\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.876579 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.876417    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlcn\" (UniqueName: \"kubernetes.io/projected/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-kube-api-access-xtlcn\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.876579 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.876450    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-podres\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.876673 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.876647    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-lib-modules\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.876710 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.876699    4497 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-proc\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978034 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.977949    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-sys\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978034 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.978001    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlcn\" (UniqueName: \"kubernetes.io/projected/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-kube-api-access-xtlcn\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978214 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.978038    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-podres\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978214 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.978076    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-sys\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978214 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.978171    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-lib-modules\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.978212    4497 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-proc\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.978225    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-lib-modules\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.978287    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-podres\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:03.978334 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:03.978303    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-proc\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:04.041713 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:04.041676    4497 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlcn\" (UniqueName: \"kubernetes.io/projected/37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0-kube-api-access-xtlcn\") pod \"perf-node-gather-daemonset-vvqhq\" (UID: \"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:04.327565 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:04.327487    4497 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:04.708582 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:04.708552    4497 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"]
Nov 04 06:13:04.715151 ip-10-0-143-195 kubenswrapper[4497]: W1104 06:13:04.715092    4497 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod37cb0ab4_9c1f_4e13_b4ea_8c0947a7f4d0.slice/crio-b9feed6fb53cd48a82dee8eeda1c6611f25c9f12b0e563e60afbd14a949da857 WatchSource:0}: Error finding container b9feed6fb53cd48a82dee8eeda1c6611f25c9f12b0e563e60afbd14a949da857: Status 404 returned error can't find the container with id b9feed6fb53cd48a82dee8eeda1c6611f25c9f12b0e563e60afbd14a949da857
Nov 04 06:13:04.968038 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:04.967935    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq" event={"ID":"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0","Type":"ContainerStarted","Data":"00d0c8db71dbae749dcbed53d29368509ecd39e4578462eea7383df74f1a4be0"}
Nov 04 06:13:04.968038 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:04.968010    4497 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq" event={"ID":"37cb0ab4-9c1f-4e13-b4ea-8c0947a7f4d0","Type":"ContainerStarted","Data":"b9feed6fb53cd48a82dee8eeda1c6611f25c9f12b0e563e60afbd14a949da857"}
Nov 04 06:13:04.968267 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:04.968060    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:05.088324 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:05.088259    4497 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq" podStartSLOduration=2.08824646 podStartE2EDuration="2.08824646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 06:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:13:05.08759624 +0000 UTC m=+1433.018793638" watchObservedRunningTime="2026-11-04 06:13:05.08824646 +0000 UTC m=+1433.019443908"
Nov 04 06:13:10.805191 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:10.805155    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:13:10.984216 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:10.984187    4497 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-vvqhq"
Nov 04 06:13:11.084560 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:11.084480    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:13:11.231369 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:11.231330    4497 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mkw6n_84b61b57-97fa-42cd-a376-cd9d9d78eeaa/konnectivity-agent/0.log" limit=1024
Nov 04 06:13:13.326880 ip-10-0-143-195 kubenswrapper[4497]: E1104 06:13:13.326841    4497 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-hf4w8" containerName="extractor"
Nov 04 06:13:14.166049 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:14.166019    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4mm4_8f7b2325-a9f4-41a2-8feb-203f6a4cee09/node-exporter/0.log"
Nov 04 06:13:14.608806 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:14.608772    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4mm4_8f7b2325-a9f4-41a2-8feb-203f6a4cee09/kube-rbac-proxy/0.log"
Nov 04 06:13:15.054710 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:15.054639    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4mm4_8f7b2325-a9f4-41a2-8feb-203f6a4cee09/init-textfile/0.log"
Nov 04 06:13:22.684399 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:22.684360    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f88b7fb75-c5sq8_6be6ce23-8666-4c97-b82b-10b27c56a9b6/thanos-query/0.log"
Nov 04 06:13:23.129243 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:23.129203    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f88b7fb75-c5sq8_6be6ce23-8666-4c97-b82b-10b27c56a9b6/kube-rbac-proxy-web/0.log"
Nov 04 06:13:23.593383 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:23.593353    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f88b7fb75-c5sq8_6be6ce23-8666-4c97-b82b-10b27c56a9b6/kube-rbac-proxy/0.log"
Nov 04 06:13:24.037795 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:24.037722    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f88b7fb75-c5sq8_6be6ce23-8666-4c97-b82b-10b27c56a9b6/prom-label-proxy/0.log"
Nov 04 06:13:24.484442 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:24.484415    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f88b7fb75-c5sq8_6be6ce23-8666-4c97-b82b-10b27c56a9b6/kube-rbac-proxy-rules/0.log"
Nov 04 06:13:24.931703 ip-10-0-143-195 kubenswrapper[4497]: I1104 06:13:24.931673    4497 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f88b7fb75-c5sq8_6be6ce23-8666-4c97-b82b-10b27c56a9b6/kube-rbac-proxy-metrics/0.log"