Oct 30 16:19:00.289613 ip-10-0-138-40 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 16:19:00.748698 ip-10-0-138-40 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:00.748698 ip-10-0-138-40 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 16:19:00.748698 ip-10-0-138-40 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:00.748698 ip-10-0-138-40 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:00.754132 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754053    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:00.754132 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754134    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754138    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754141    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754144    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754148    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754151    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754154    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754156    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754159    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754162    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754165    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754167    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754170    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754173    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754175    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754178    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754180    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754183    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754193    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754196    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:00.754201 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754198    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754201    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754204    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754207    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754210    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754213    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754216    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754219    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754221    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754224    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754226    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754229    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754232    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754234    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754237    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754240    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754242    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754245    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754248    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754250    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:00.754682 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754253    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754255    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754258    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754261    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754264    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754266    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754277    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754282    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754285    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754287    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754290    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754293    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754295    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754298    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754301    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754304    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754306    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754309    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754312    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:00.755150 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754314    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754317    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754320    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754322    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754325    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754328    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754330    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754333    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754335    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754351    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754354    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754356    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754359    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754362    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754365    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754368    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754370    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754373    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754375    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754378    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:00.755623 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754381    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754385    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754390    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754393    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754396    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754398    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754401    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754405    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754409    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754412    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754415    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754418    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754420    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754423    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754426    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754429    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754431    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754434    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754437    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:00.756129 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754440    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754442    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754445    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754447    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754450    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754452    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.754455    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755224    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755230    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755233    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755237    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755240    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755243    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755245    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755248    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755251    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755254    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755257    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755260    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:00.756583 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755263    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755266    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755269    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755272    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755275    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755278    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755281    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755283    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755286    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755289    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755291    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755294    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755297    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755300    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755302    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755305    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755307    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755310    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755313    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:00.757046 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755315    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755326    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755329    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755332    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755335    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755352    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755355    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755357    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755360    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755363    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755367    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755370    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755374    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755378    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755381    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755383    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755386    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755389    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755391    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755394    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:00.757496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755397    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755399    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755402    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755404    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755407    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755409    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755414    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755417    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755421    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755424    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755427    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755430    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755432    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755435    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755437    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755440    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755442    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755445    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755448    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755451    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:00.757976 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755454    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755457    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755460    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755463    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755466    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755468    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755471    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755474    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755476    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755479    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755481    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755484    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755487    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755489    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755492    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755495    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755497    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755500    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755502    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755505    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:00.758496 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755508    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755510    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755513    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755515    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755518    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755520    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755523    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755526    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755529    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755534    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755537    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755539    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755542    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755544    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.755547    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756085    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756091    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756095    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756098    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756100    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:00.758982 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756103    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756106    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756109    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756111    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756114    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756116    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756119    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756121    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756124    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756127    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756131    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756135    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756138    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756142    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756145    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756147    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756150    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756152    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756155    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756158    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:00.759467 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756160    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756165    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756167    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756170    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756172    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756175    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756178    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756181    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756184    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756187    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756189    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756192    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756194    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756197    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756201    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756205    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756209    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756211    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756214    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:00.760003 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756217    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756220    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756222    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756225    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756228    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756230    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756233    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756235    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756238    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756240    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756243    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756246    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756248    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756251    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756255    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756258    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756260    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756263    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756266    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756268    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:00.760461 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756273    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756276    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756279    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756282    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756285    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756287    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756290    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756292    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756295    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756297    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756300    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756302    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756305    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756308    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756310    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756313    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756316    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756318    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756321    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:00.760943 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756323    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756326    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756328    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756331    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756334    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756349    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756352    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756357    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756359    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756362    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756365    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756368    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756370    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756374    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756378    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756381    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756384    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756386    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756389    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:00.761405 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756392    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756394    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756397    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.756399    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757446    2583 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757463    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757469    2583 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757474    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757479    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757482    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757487    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757491    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757495    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757498    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757502    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757505    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757509    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757512    2583 flags.go:64] FLAG: --cgroup-root=""
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757515    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757518    2583 flags.go:64] FLAG: --client-ca-file=""
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757522    2583 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757525    2583 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757530    2583 flags.go:64] FLAG: --cluster-domain=""
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757533    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 16:19:00.761857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757536    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757539    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757544    2583 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757548    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757551    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757554    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757558    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757561    2583 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757564    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757567    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757571    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757574    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757579    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757582    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757585    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757588    2583 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757591    2583 flags.go:64] FLAG: --enable-server="true"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757594    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757598    2583 flags.go:64] FLAG: --event-burst="100"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757601    2583 flags.go:64] FLAG: --event-qps="50"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757604    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757607    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757610    2583 flags.go:64] FLAG: --eviction-hard=""
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757615    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 16:19:00.762436 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757618    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757621    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757624    2583 flags.go:64] FLAG: --eviction-soft=""
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757627    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757630    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757633    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757636    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757640    2583 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757643    2583 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757646    2583 flags.go:64] FLAG: --feature-gates=""
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757650    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757653    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757656    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757660    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757662    2583 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757666    2583 flags.go:64] FLAG: --help="false"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757669    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757673    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757676    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757679    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757683    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757686    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757689    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 16:19:00.763039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757692    2583 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757695    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757698    2583 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757701    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757705    2583 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757707    2583 flags.go:64] FLAG: --kube-reserved=""
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757710    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757714    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757717    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757720    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757723    2583 flags.go:64] FLAG: --lock-file=""
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757726    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757729    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757733    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757738    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757741    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757744    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757747    2583 flags.go:64] FLAG: --logging-format="text"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757750    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757754    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757757    2583 flags.go:64] FLAG: --manifest-url=""
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757760    2583 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757764    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757767    2583 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757771    2583 flags.go:64] FLAG: --max-pods="110"
Oct 30 16:19:00.763629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757775    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757778    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757781    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757784    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757787    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757790    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757793    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757801    2583 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757804    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757807    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757810    2583 flags.go:64] FLAG: --pod-cidr=""
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757813    2583 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757816    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757820    2583 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757823    2583 flags.go:64] FLAG: --port="10250"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757826    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757828    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05fa089b3ddbd6cfc"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757832    2583 flags.go:64] FLAG: --qos-reserved=""
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757835    2583 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757838    2583 flags.go:64] FLAG: --register-node="true"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757841    2583 flags.go:64] FLAG: --register-with-taints=""
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757845    2583 flags.go:64] FLAG: --registry-burst="10"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757848    2583 flags.go:64] FLAG: --registry-qps="5"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757851    2583 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757854    2583 flags.go:64] FLAG: --reserved-memory=""
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757858    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 16:19:00.764206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757861    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757864    2583 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757867    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757870    2583 flags.go:64] FLAG: --runonce="false"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757873    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757876    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757879    2583 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757883    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757886    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757889    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757892    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757895    2583 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757898    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757901    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757904    2583 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757907    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757910    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757913    2583 flags.go:64] FLAG: --system-cgroups=""
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757916    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757922    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757925    2583 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757928    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757932    2583 flags.go:64] FLAG: --tls-min-version=""
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757934    2583 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757937    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 16:19:00.764855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757942    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757945    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757948    2583 flags.go:64] FLAG: --v="2"
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757953    2583 flags.go:64] FLAG: --version="false"
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757959    2583 flags.go:64] FLAG: --vmodule=""
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757963    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.757967    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758106    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758111    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758114    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758117    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758120    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758123    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758125    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758128    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758131    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758134    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758137    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758139    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758142    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758145    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758147    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:00.765457 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758150    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758152    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758155    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758157    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758160    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758163    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758166    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758168    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758172    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758176    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758180    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758183    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758186    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758188    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758192    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758195    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758198    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758200    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:00.765971 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758203    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758206    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758208    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758211    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758213    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758216    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758219    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758221    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758224    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758227    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758229    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758232    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758235    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758237    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758240    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758242    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758245    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758248    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758250    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:00.766413 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758253    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758256    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758258    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758261    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758263    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758268    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758270    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758273    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758276    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758280    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758282    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758285    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758287    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758290    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758294    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758298    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758301    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758304    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758307    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:00.766860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758310    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758312    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758315    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758318    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758321    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758324    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758326    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758329    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758331    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758334    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758350    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758353    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758355    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758358    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758360    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758363    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758366    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758368    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758372    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758375    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:00.767423 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758377    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758380    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758384    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758387    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758389    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758392    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758395    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758398    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758400    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758403    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758405    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758408    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758411    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758413    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758416    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.758443    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:00.767901 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758478    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758482    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758485    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758487    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758490    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758493    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758496    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758499    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758502    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758504    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758507    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758510    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758514    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758517    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758521    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758524    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758526    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758529    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758532    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:00.768283 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758536    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758539    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758541    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758544    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758547    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758549    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758552    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758554    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758557    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758559    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758562    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758564    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758567    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758570    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758573    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758575    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758578    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758581    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758583    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758586    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:00.768747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758588    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758591    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758593    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758596    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758599    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758601    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758604    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758608    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758611    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758613    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758615    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758618    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758622    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758625    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758628    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758630    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758633    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758635    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758638    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758640    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:00.769214 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758643    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758646    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758649    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758651    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758654    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758657    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758659    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758662    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758665    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758667    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758670    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758672    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758675    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758678    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758680    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758683    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758687    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758690    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758694    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:00.769692 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758698    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758701    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758704    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758706    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758709    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758712    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758715    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758718    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758720    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758723    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758725    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758728    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758730    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758733    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758736    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758738    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758741    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758744    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758746    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:00.770130 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758749    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758751    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758754    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758757    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758760    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758762    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758765    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758767    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.758771    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.766299    2583 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.766315    2583 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.766332    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.766347    2583 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766427    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766433    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766437    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766440    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766444    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766448    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766452    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:00.770622 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766457    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766461    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766464    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766467    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766470    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766472    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766475    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766478    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766480    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766483    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766486    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766489    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766491    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766500    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766504    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766507    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766510    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766512    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766515    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:00.771084 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766518    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766520    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766523    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766527    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766531    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766536    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766540    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766543    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766546    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766549    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766551    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766554    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766557    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766560    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766562    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766565    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766567    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766570    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766573    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766575    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:00.771555 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766578    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766580    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766583    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766586    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766588    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766591    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766594    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766605    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766609    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766613    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766617    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766621    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766624    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766626    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766629    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766632    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766635    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766637    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766640    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766643    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:00.772031 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766645    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766648    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766650    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766653    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766655    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766658    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766661    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766663    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766666    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766668    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766671    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766674    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766676    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766679    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766682    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766685    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766689    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766693    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766697    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:00.772610 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766701    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766710    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766712    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766715    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766717    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766720    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766724    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766728    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766732    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766734    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766737    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766740    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766742    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766745    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766747    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766750    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766753    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766755    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766758    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:00.773041 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766761    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.766766    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.766799    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767042    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767048    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767051    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767054    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767057    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767060    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767062    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767065    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767067    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767070    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767073    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767075    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:00.773493 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767086    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767091    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767095    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767097    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767100    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767103    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767106    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767109    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767111    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767114    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767117    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767120    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767122    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767125    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767128    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767130    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767133    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767135    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767138    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:00.773983 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767141    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767143    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767146    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767148    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767151    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767154    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767157    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767161    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767167    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767173    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767176    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767179    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767182    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767184    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767193    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767196    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767198    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767201    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767203    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:00.774731 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767206    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767211    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767214    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767217    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767220    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767223    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767226    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767228    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767231    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767233    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767236    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767241    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767245    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767249    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767252    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767255    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767258    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767260    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767263    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767265    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:00.775303 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767268    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767270    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767273    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767275    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767278    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767281    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767283    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767286    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767294    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767297    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767299    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767302    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767305    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767307    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767310    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767312    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767316    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767327    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767331    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767335    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:00.775839 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767352    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767355    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767358    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767360    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767363    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767365    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767368    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767370    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767373    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767376    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767378    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767381    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767383    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767386    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767388    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767391    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:00.776329 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.767421    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767467    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767475    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767478    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767481    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767491    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767496    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767500    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767503    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767509    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767512    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767514    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767517    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767520    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767522    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767525    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767527    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767530    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767533    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767535    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:00.776747 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767537    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767540    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767543    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767545    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767548    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767550    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767553    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767555    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767558    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767561    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767564    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767568    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767572    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767576    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767580    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767583    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767585    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767588    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767596    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767599    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:00.777487 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767602    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767604    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767607    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767610    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767612    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767615    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767617    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767620    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767622    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767625    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767627    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767630    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767632    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767634    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767637    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767639    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767642    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767646    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767651    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767655    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:00.778224 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767659    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767661    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767664    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767669    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767671    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767674    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767676    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767679    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767682    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767684    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767687    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767695    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767698    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767701    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767703    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767706    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767709    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767718    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767720    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:00.778751 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767724    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767728    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767733    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767737    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767741    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767743    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767746    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767749    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767751    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767754    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767756    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767759    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767761    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767764    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767766    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767769    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767774    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767778    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767782    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:00.779192 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767784    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767787    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767790    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767793    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767795    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767799    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767814    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767819    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:00.767822    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.767885    2583 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.770387    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.771473    2583 server.go:1014] "Starting client certificate rotation"
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.771579    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.771613    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.775407    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:19:00.779860 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.777649    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:19:00.787275 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.787260    2583 log.go:25] "Validated CRI v1 runtime API"
Oct 30 16:19:00.791123 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.791108    2583 log.go:25] "Validated CRI v1 image API"
Oct 30 16:19:00.791961 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.791931    2583 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 16:19:00.797132 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.797113    2583 fs.go:135] Filesystem UUIDs: map[3291b41a-938f-4420-98be-fb4f746149b6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c8ffa649-78ba-46cc-ba72-c982ec8bc064:/dev/nvme0n1p3]
Oct 30 16:19:00.797188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.797133    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 16:19:00.803211 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.803078    2583 manager.go:217] Machine: {Timestamp:2026-10-30 16:19:00.801703869 +0000 UTC m=+0.384461929 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105479 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ff90025f36d33463445823222b29 SystemUUID:ec20ff90-025f-36d3-3463-445823222b29 BootID:a47d33aa-a1cb-4a12-b210-6dd1ceae15a9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d9:f4:41:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d9:f4:41:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:7d:37:34:a9:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 16:19:00.803886 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.803875    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 16:19:00.803965 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.803953    2583 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 16:19:00.807586 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.807566    2583 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 16:19:00.807735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.807587    2583 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 16:19:00.807776 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.807741    2583 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 16:19:00.807776 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.807748    2583 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 16:19:00.807832 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.807779    2583 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 16:19:00.807832 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.807798    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 16:19:00.809206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.809196    2583 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 16:19:00.813910 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.813888    2583 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 16:19:00.814038 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.814029    2583 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 16:19:00.814842 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.814832    2583 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 16:19:00.814901 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.814846    2583 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 16:19:00.814901 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.814861    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 16:19:00.814901 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.814869    2583 kubelet.go:405] "Adding apiserver pod source"
Oct 30 16:19:00.814901 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.814877    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 16:19:00.815255 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.815237    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 16:19:00.819288 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.819264    2583 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 16:19:00.826244 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.826232    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 16:19:00.827130 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.827118    2583 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 16:19:00.827178 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.827148    2583 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 16:19:00.827296 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.827285    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 16:19:00.827351 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.827300    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 16:19:00.827351 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.827307    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 16:19:00.827351 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.827312    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 16:19:00.827351 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.827327    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 16:19:00.827351 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.827335    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 16:19:00.828023 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.828014    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 16:19:00.828023 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.828023    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 16:19:00.828074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.828030    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 16:19:00.828074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.828036    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 16:19:00.828074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.828044    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 16:19:00.828074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.828053    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 16:19:00.828782 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.828772    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 16:19:00.828782 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.828782    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 16:19:00.832725 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.832702    2583 server.go:1263] "Started kubelet"
Oct 30 16:19:00.832797 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.832770    2583 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 16:19:00.832889 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.832836    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 16:19:00.832924 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.832911    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 16:19:00.833375 ip-10-0-138-40 systemd[1]: Started Kubernetes Kubelet.
Oct 30 16:19:00.835133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.835021    2583 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 16:19:00.837756 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.837741    2583 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 16:19:00.839099 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.839081    2583 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 16:19:00.844569 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.844553    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 16:19:00.845913 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.845898    2583 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 16:19:00.846020 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.846006    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:00.846710 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.846692    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 16:19:00.846844 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.846830    2583 factory.go:55] Registering systemd factory
Oct 30 16:19:00.846911 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.846849    2583 factory.go:223] Registration of the systemd container factory successfully
Oct 30 16:19:00.846911 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.846815    2583 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 16:19:00.846911 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.846881    2583 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 16:19:00.847034 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.846982    2583 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 16:19:00.847034 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.846993    2583 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 16:19:00.847130 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.847087    2583 factory.go:153] Registering CRI-O factory
Oct 30 16:19:00.847130 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.847101    2583 factory.go:223] Registration of the crio container factory successfully
Oct 30 16:19:00.847215 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.847153    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 16:19:00.847215 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.847180    2583 factory.go:103] Registering Raw factory
Oct 30 16:19:00.847215 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.847197    2583 manager.go:1199] Started watching for new ooms in manager
Oct 30 16:19:00.848241 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.848227    2583 manager.go:319] Starting recovery of all containers
Oct 30 16:19:00.860206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.860190    2583 manager.go:324] Recovery completed
Oct 30 16:19:00.864923 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.864911    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:00.866925 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.866910    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:00.866983 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.866939    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:00.866983 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.866949    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:00.867452 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.867437    2583 cpu_manager.go:226] "Starting" policy="none"
Oct 30 16:19:00.867494 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.867451    2583 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 16:19:00.867494 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.867471    2583 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 16:19:00.867563 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.867454    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:00.868194 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.868178    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:00.868258 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.868207    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:00.868258 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.868219    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:00.869720 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.869708    2583 policy_none.go:50] "Start"
Oct 30 16:19:00.869774 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.869726    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 16:19:00.869774 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.869739    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 16:19:00.871744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.871731    2583 policy_none.go:44] "Start"
Oct 30 16:19:00.872639 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.872604    2583 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 16:19:00.874077 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.874055    2583 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 16:19:00.874077 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.874055    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-40.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 16:19:00.875380 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.874054    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-40.ec2.internal.18e35b0203a2fd35  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-40.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-40.ec2.internal,},FirstTimestamp:2026-10-30 16:19:00.832664885 +0000 UTC m=+0.415422945,LastTimestamp:2026-10-30 16:19:00.832664885 +0000 UTC m=+0.415422945,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-40.ec2.internal,}"
Oct 30 16:19:00.893357 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.893258    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-40.ec2.internal.18e35b0205adc4a8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-40.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-40.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-40.ec2.internal,},FirstTimestamp:2026-10-30 16:19:00.866925736 +0000 UTC m=+0.449683796,LastTimestamp:2026-10-30 16:19:00.866925736 +0000 UTC m=+0.449683796,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-40.ec2.internal,}"
Oct 30 16:19:00.893888 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.893866    2583 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 16:19:00.893950 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.893867    2583 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 16:19:00.899057 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.899027    2583 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 16:19:00.902158 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.902146    2583 manager.go:341] "Starting Device Plugin manager"
Oct 30 16:19:00.902258 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.902173    2583 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 16:19:00.902258 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.902181    2583 server.go:87] "Starting device plugin registration server"
Oct 30 16:19:00.902430 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.902418    2583 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 16:19:00.902488 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.902465    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 16:19:00.902714 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.902650    2583 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 16:19:00.903076 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.903057    2583 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 16:19:00.903076 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.903071    2583 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 16:19:00.903171 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.903081    2583 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 16:19:00.903171 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.903103    2583 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.910217    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzln4"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.922598    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.923821    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.923845    2583 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.923866    2583 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.923908    2583 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.924621    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzln4"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.924978    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-40.ec2.internal.18e35b0205ae0acd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-40.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-40.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-40.ec2.internal,},FirstTimestamp:2026-10-30 16:19:00.866943693 +0000 UTC m=+0.449701752,LastTimestamp:2026-10-30 16:19:00.866943693 +0000 UTC m=+0.449701752,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-40.ec2.internal,}"
Oct 30 16:19:00.927995 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:00.925148    2583 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 16:19:00.949058 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:00.949040    2583 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:01.003594 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.003540    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:01.004447 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.004431    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:01.004537 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.004465    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:01.004537 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.004481    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:01.004537 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.004511    2583 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.025019 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.024978    2583 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"]
Oct 30 16:19:01.025092 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.025049    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:01.025888 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.025872    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:01.025993 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.025904    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:01.025993 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.025918    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:01.028351 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.028324    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:01.028479 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.028462    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.028532 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.028498    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:01.029071 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.029052    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:01.029171 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.029081    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:01.029171 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.029097    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:01.029171 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.029113    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:01.029171 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.029134    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:01.029171 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.029144    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:01.030607 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.030591    2583 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.030667 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.030612    2583 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-40.ec2.internal\": node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:01.031211 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.031197    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.031255 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.031219    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:01.031866 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.031849    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:01.031947 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.031880    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:01.031947 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.031895    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:01.048464 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.048298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.048547 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.048481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.048547 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.048501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5516ee241b7eda607841dfd15963de2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-40.ec2.internal\" (UID: \"5516ee241b7eda607841dfd15963de2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.071027 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.071008    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:01.071962 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.071941    2583 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-40.ec2.internal\" not found" node="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.074681 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.074665    2583 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-40.ec2.internal\" not found" node="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.149220 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.149196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.149401 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.149227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.149401 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.149251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5516ee241b7eda607841dfd15963de2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-40.ec2.internal\" (UID: \"5516ee241b7eda607841dfd15963de2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.149401 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.149309    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5516ee241b7eda607841dfd15963de2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-40.ec2.internal\" (UID: \"5516ee241b7eda607841dfd15963de2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.149401 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.149311    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.149401 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.149309    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.171829 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.171810    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:01.272809 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.272755    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:01.373822 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.373795    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:01.377957 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.377941    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.380093 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.380079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.474090 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.474056    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:01.574619 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.574554    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:01.675194 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.675157    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:01.761454 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.761428    2583 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:01.771448 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.771419    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 16:19:01.771600 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.771569    2583 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 16:19:01.771657 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.771612    2583 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 16:19:01.815638 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.815594    2583 apiserver.go:52] "Watching apiserver"
Oct 30 16:19:01.845581 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.845511    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 16:19:01.846101 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.846080    2583 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.900893 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.900868    2583 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 16:19:01.901175 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.901157    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-xl9bk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8","openshift-cluster-node-tuning-operator/tuned-82qt4","openshift-multus/multus-additional-cni-plugins-dlcgr","kube-system/global-pull-secret-syncer-4xnzd","openshift-image-registry/node-ca-9s5vn","openshift-network-diagnostics/network-check-target-7c4px","openshift-ovn-kubernetes/ovnkube-node-jxtgs","openshift-dns/node-resolver-k4b9s","kube-system/konnectivity-agent-bvzgm","openshift-multus/multus-2clff","openshift-multus/network-metrics-daemon-rttw4"]
Oct 30 16:19:01.904509 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.904484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:01.906855 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.906831    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:01.910128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.910106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.910977 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.910960    2583 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:19:01.911081 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.911038    2583 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:01.912616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.912600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:01.914805 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.914790    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:01.914877 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.914848    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:01.916988 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.916970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:01.919409 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.919390    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:01.919506 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.919462    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:01.921286 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.921265    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8qclp\""
Oct 30 16:19:01.921500 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.921483    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:01.921608 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.921593    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:01.921675 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.921640    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 16:19:01.921876 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.921854    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.923074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.923052    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 16:19:01.923177 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.923156    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 16:19:01.925510 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.923168    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-svxjg\""
Oct 30 16:19:01.925510 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.924473    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 16:19:01.925991 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.925969    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:01.926299 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.926276    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j7zxr\""
Oct 30 16:19:01.926404 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.926314    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:01.926973 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.926956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:01.929574 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.929549    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:01.929732 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.929711    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 16:19:01.929848 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.929832    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 16:19:01.929919 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.929846    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 16:19:01.929919 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.929905    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cpfx5\""
Oct 30 16:19:01.930027 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.929923    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 16:19:01.930077 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.929971    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 16:14:01 +0000 UTC" deadline="2028-07-13 15:44:45.1895613 +0000 UTC"
Oct 30 16:19:01.930077 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.930043    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14927h25m43.259522278s"
Oct 30 16:19:01.930228 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.930084    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 16:19:01.932049 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.932034    2583 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 16:19:01.932112 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.932088    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zxh6b"
Oct 30 16:19:01.932466 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.932445    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.935289 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:01.935264    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fb9ae397c79a585da42d7d21f809ee.slice/crio-d7a199c4b6899687dc5a371143f408b5a1a1f5f3d6ac5160a5677795c4ae860e WatchSource:0}: Error finding container d7a199c4b6899687dc5a371143f408b5a1a1f5f3d6ac5160a5677795c4ae860e: Status 404 returned error can't find the container with id d7a199c4b6899687dc5a371143f408b5a1a1f5f3d6ac5160a5677795c4ae860e
Oct 30 16:19:01.935428 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.935408    2583 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:19:01.935500 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:01.935474    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5516ee241b7eda607841dfd15963de2b.slice/crio-7da9c9e54c0ce6ce7ce4b284f481d1036b6b47ce24b1b23829cacf57f82951ee WatchSource:0}: Error finding container 7da9c9e54c0ce6ce7ce4b284f481d1036b6b47ce24b1b23829cacf57f82951ee: Status 404 returned error can't find the container with id 7da9c9e54c0ce6ce7ce4b284f481d1036b6b47ce24b1b23829cacf57f82951ee
Oct 30 16:19:01.940095 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.940073    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:19:01.942929 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.942908    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"]
Oct 30 16:19:01.943027 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.942937    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"]
Oct 30 16:19:01.943094 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.943030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:01.943145 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:01.943098    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:01.947509 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.947491    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 16:19:01.953768 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.953747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-kubernetes\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.953874 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.953786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-etc-kubernetes\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.953874 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.953818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:01.953986 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.953879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-host\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:01.953986 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.953936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-systemd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.954080 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.953985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-bin\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.954080 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ac16845-91f4-48c7-a02c-84fedf86171d-host-slash\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:01.954149 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-daemon-config\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.954198 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5twf\" (UniqueName: \"kubernetes.io/projected/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-kube-api-access-v5twf\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:01.954256 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.954301 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-konnectivity-ca\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:01.954345 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysconfig\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.954418 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d06c87-6ddd-4605-9322-9e13e26eaaa4-hosts-file\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:01.954477 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d06c87-6ddd-4605-9322-9e13e26eaaa4-tmp-dir\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:01.954477 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-cni-binary-copy\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.954561 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-socket-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:01.954598 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:01.954641 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954593    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ac16845-91f4-48c7-a02c-84fedf86171d-iptables-alerter-script\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:01.954677 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-conf\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.954726 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954680    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-bin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.954726 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9s4\" (UniqueName: \"kubernetes.io/projected/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kube-api-access-rs9s4\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:01.954829 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954745    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:01.954829 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-systemd-units\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.954829 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgt5l\" (UniqueName: \"kubernetes.io/projected/8ac16845-91f4-48c7-a02c-84fedf86171d-kube-api-access-rgt5l\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:01.954959 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-kubelet-config\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:01.954959 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954905    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-k8s-cni-cncf-io\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.954959 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:01.955122 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.954988    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-systemd\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.955122 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955034    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-run\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.955122 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-sys-fs\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:01.955122 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-netd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.955271 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955142    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw7qz\" (UniqueName: \"kubernetes.io/projected/5806cd90-2896-488a-ac38-10fc6d959026-kube-api-access-zw7qz\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:01.955271 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-var-lib-kubelet\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.955271 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955204    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-tuned\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.955271 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:01.955271 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-socket-dir-parent\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.955533 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955312    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-kubelet\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.955533 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-etc-selinux\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:01.955533 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:01.955533 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-modprobe-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.955665 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-sys\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.955665 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b4h2\" (UniqueName: \"kubernetes.io/projected/72030764-3f04-44d3-97fe-3d0da005a6a2-kube-api-access-6b4h2\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.955665 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-dbus\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:01.955665 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:01.955665 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-device-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:01.955849 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955674    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-kubelet\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.955849 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-slash\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.955849 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-tmp\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.955849 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955804    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.955849 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-registration-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:01.956069 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956069 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.956069 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955946    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-lib-modules\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.956069 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.955987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-multus-certs\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.956069 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-serviceca\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:01.956069 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-netns\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956069 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956062    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovn-node-metrics-cert\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956088    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-script-lib\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-etc-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-log-socket\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956219    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-config\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98tr6\" (UniqueName: \"kubernetes.io/projected/10e23d4f-4633-46b8-882f-3acabfb8a3f1-kube-api-access-98tr6\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-agent-certs\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-netns\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-conf-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.956386 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7q2d\" (UniqueName: \"kubernetes.io/projected/e5b373b2-2951-49d8-98a5-221c47b724c0-kube-api-access-x7q2d\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.956744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-var-lib-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-env-overrides\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqcch\" (UniqueName: \"kubernetes.io/projected/37d06c87-6ddd-4605-9322-9e13e26eaaa4-kube-api-access-sqcch\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:01.956744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-hostroot\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.956744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-ovn\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-node-log\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:01.956744 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956698    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:01.957074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956751    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-host\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:01.957074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-system-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.957074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-cnibin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.957074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-multus\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:01.957074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-system-cni-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:01.957074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-cnibin\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:01.957074 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:01.956946    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnd4f\" (UniqueName: \"kubernetes.io/projected/88847d7c-8749-4920-9c90-97f93bbfc432-kube-api-access-fnd4f\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:02.030733 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.030699    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 16:19:02.030844 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.030738    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 16:19:02.030844 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.030786    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 16:19:02.030844 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.030795    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 16:19:02.031209 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.031117    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-8fzhw\""
Oct 30 16:19:02.031557 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.031539    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 16:19:02.031653 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.031636    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 16:19:02.031842 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.031827    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 16:19:02.031922 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.031838    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 16:19:02.032049 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032032    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 16:19:02.032126 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032107    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 16:19:02.032126 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032104    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2smlp\""
Oct 30 16:19:02.032126 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032122    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-dlk52\""
Oct 30 16:19:02.032309 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032186    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 16:19:02.032309 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032034    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 16:19:02.032557 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032538    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 16:19:02.032749 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032735    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v666l\""
Oct 30 16:19:02.032848 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032829    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6x9tv\""
Oct 30 16:19:02.032924 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.032861    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 16:19:02.057193 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-dbus\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:02.057302 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057213    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:02.057302 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057231    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-device-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.057302 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-kubelet\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.057302 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057296    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-kubelet\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-slash\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-tmp\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057330    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-device-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057328    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-slash\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057373    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-dbus\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057408    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-registration-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057425    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057476    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-registration-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057502    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.057544 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-lib-modules\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-multus-certs\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-serviceca\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057591    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057609    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-multus-certs\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057623    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-lib-modules\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057628    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-netns\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovn-node-metrics-cert\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057643    2583 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-script-lib\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-etc-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057729    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-log-socket\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057668    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-netns\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-config\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057779    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-etc-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057817    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-log-socket\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tr6\" (UniqueName: \"kubernetes.io/projected/10e23d4f-4633-46b8-882f-3acabfb8a3f1-kube-api-access-98tr6\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-agent-certs\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:02.058188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-netns\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-conf-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7q2d\" (UniqueName: \"kubernetes.io/projected/e5b373b2-2951-49d8-98a5-221c47b724c0-kube-api-access-x7q2d\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.057993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-var-lib-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-env-overrides\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058081    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-serviceca\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqcch\" (UniqueName: \"kubernetes.io/projected/37d06c87-6ddd-4605-9322-9e13e26eaaa4-kube-api-access-sqcch\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-hostroot\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-ovn\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-node-log\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058167    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-var-lib-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058223    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-netns\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-host\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058274    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-conf-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-system-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058288    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-hostroot\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.059133 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058327    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-script-lib\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058348    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058357    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-config\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058365    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-system-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058415    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-host\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058474    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-ovn\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058479    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-cnibin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.058482    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-cnibin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058531    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-node-log\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-multus\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058581    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-multus\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.058588    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs podName:88847d7c-8749-4920-9c90-97f93bbfc432 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:02.558545153 +0000 UTC m=+2.141303224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs") pod "network-metrics-daemon-rttw4" (UID: "88847d7c-8749-4920-9c90-97f93bbfc432") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-system-cni-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-cnibin\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnd4f\" (UniqueName: \"kubernetes.io/projected/88847d7c-8749-4920-9c90-97f93bbfc432-kube-api-access-fnd4f\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058761    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-system-cni-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.060039 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-kubernetes\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-etc-kubernetes\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058818    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-env-overrides\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058846    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-kubernetes\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058867    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-host\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058924    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-cnibin\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-systemd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.058990    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-host\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-bin\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059047    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-systemd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059052    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-bin\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ac16845-91f4-48c7-a02c-84fedf86171d-host-slash\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059097    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-etc-kubernetes\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-daemon-config\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5twf\" (UniqueName: \"kubernetes.io/projected/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-kube-api-access-v5twf\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059221    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ac16845-91f4-48c7-a02c-84fedf86171d-host-slash\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.060934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-konnectivity-ca\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysconfig\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059388    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d06c87-6ddd-4605-9322-9e13e26eaaa4-hosts-file\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059439    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d06c87-6ddd-4605-9322-9e13e26eaaa4-tmp-dir\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-cni-binary-copy\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-socket-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ac16845-91f4-48c7-a02c-84fedf86171d-iptables-alerter-script\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059639    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-conf\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-bin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9s4\" (UniqueName: \"kubernetes.io/projected/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kube-api-access-rs9s4\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-systemd-units\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059764    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-daemon-config\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgt5l\" (UniqueName: \"kubernetes.io/projected/8ac16845-91f4-48c7-a02c-84fedf86171d-kube-api-access-rgt5l\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:02.061627 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059839    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d06c87-6ddd-4605-9322-9e13e26eaaa4-hosts-file\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059880    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-socket-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059884    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-bin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059922    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-konnectivity-ca\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059966    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-cni-binary-copy\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-kubelet-config\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060173    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-kubelet-config\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060215    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-systemd-units\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060219    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d06c87-6ddd-4605-9322-9e13e26eaaa4-tmp-dir\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060268    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-conf\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-k8s-cni-cncf-io\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060375    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060410    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-k8s-cni-cncf-io\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-systemd\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060474    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-run\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-sys-fs\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060526    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-systemd\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-netd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060516    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060567    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-run\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7qz\" (UniqueName: \"kubernetes.io/projected/5806cd90-2896-488a-ac38-10fc6d959026-kube-api-access-zw7qz\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060590    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-sys-fs\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-var-lib-kubelet\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-tuned\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060633    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-netd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-socket-dir-parent\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060697    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-var-lib-kubelet\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-kubelet\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-etc-selinux\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.059496    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysconfig\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.060770    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.062748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-modprobe-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.060820    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret podName:fc642127-45e3-46e5-897f-93b899a68127 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:02.560801415 +0000 UTC m=+2.143559477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret") pod "global-pull-secret-syncer-4xnzd" (UID: "fc642127-45e3-46e5-897f-93b899a68127") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060820    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-socket-dir-parent\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060839    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ac16845-91f4-48c7-a02c-84fedf86171d-iptables-alerter-script\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-sys\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060871    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-kubelet\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b4h2\" (UniqueName: \"kubernetes.io/projected/72030764-3f04-44d3-97fe-3d0da005a6a2-kube-api-access-6b4h2\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060887    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-modprobe-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060922    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-etc-selinux\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.060959    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-sys\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.061325    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.061867    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-tmp\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.061960    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovn-node-metrics-cert\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.062183    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-agent-certs\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:02.063306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.062886    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-tuned\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.081693 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.081666    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:02.081693 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.081693    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:02.081823 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.081714    2583 projected.go:196] Error preparing data for projected volume kube-api-access-lwzmt for pod openshift-network-diagnostics/network-check-target-7c4px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:02.081823 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.081790    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt podName:7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:02.581771389 +0000 UTC m=+2.164529463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lwzmt" (UniqueName: "kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt") pod "network-check-target-7c4px" (UID: "7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:02.084610 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.084584    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7q2d\" (UniqueName: \"kubernetes.io/projected/e5b373b2-2951-49d8-98a5-221c47b724c0-kube-api-access-x7q2d\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.084741 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.084609    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tr6\" (UniqueName: \"kubernetes.io/projected/10e23d4f-4633-46b8-882f-3acabfb8a3f1-kube-api-access-98tr6\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.085010 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.084991    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqcch\" (UniqueName: \"kubernetes.io/projected/37d06c87-6ddd-4605-9322-9e13e26eaaa4-kube-api-access-sqcch\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:02.085178 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.085157    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9s4\" (UniqueName: \"kubernetes.io/projected/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kube-api-access-rs9s4\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.085459 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.085436    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnd4f\" (UniqueName: \"kubernetes.io/projected/88847d7c-8749-4920-9c90-97f93bbfc432-kube-api-access-fnd4f\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:02.086210 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.086170    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5twf\" (UniqueName: \"kubernetes.io/projected/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-kube-api-access-v5twf\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:02.086560 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.086539    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7qz\" (UniqueName: \"kubernetes.io/projected/5806cd90-2896-488a-ac38-10fc6d959026-kube-api-access-zw7qz\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.086634 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.086538    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgt5l\" (UniqueName: \"kubernetes.io/projected/8ac16845-91f4-48c7-a02c-84fedf86171d-kube-api-access-rgt5l\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:02.086924 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.086905    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b4h2\" (UniqueName: \"kubernetes.io/projected/72030764-3f04-44d3-97fe-3d0da005a6a2-kube-api-access-6b4h2\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.247723 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.247684    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:02.257743 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.257722    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:02.258056 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:02.258022    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac16845_91f4_48c7_a02c_84fedf86171d.slice/crio-f807fa47632726c046e6f82b99def2a4d97328e96c65f3f242dcb2986b5b1830 WatchSource:0}: Error finding container f807fa47632726c046e6f82b99def2a4d97328e96c65f3f242dcb2986b5b1830: Status 404 returned error can't find the container with id f807fa47632726c046e6f82b99def2a4d97328e96c65f3f242dcb2986b5b1830
Oct 30 16:19:02.261880 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.261857    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:02.268139 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:02.268117    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcd8fb6_aaea_456a_bf39_c58f04323aee.slice/crio-1a9c91d9f6b201a2225c2b51bd9239b242acc35a9694e1300e8de9d2cfbfefa2 WatchSource:0}: Error finding container 1a9c91d9f6b201a2225c2b51bd9239b242acc35a9694e1300e8de9d2cfbfefa2: Status 404 returned error can't find the container with id 1a9c91d9f6b201a2225c2b51bd9239b242acc35a9694e1300e8de9d2cfbfefa2
Oct 30 16:19:02.270768 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:02.270744    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72030764_3f04_44d3_97fe_3d0da005a6a2.slice/crio-ec9104ba592f8b044d2ae4fc3dc4838dae4c4bf345a22b665efb1fec1636e605 WatchSource:0}: Error finding container ec9104ba592f8b044d2ae4fc3dc4838dae4c4bf345a22b665efb1fec1636e605: Status 404 returned error can't find the container with id ec9104ba592f8b044d2ae4fc3dc4838dae4c4bf345a22b665efb1fec1636e605
Oct 30 16:19:02.276903 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.276882    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:02.283068 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.283041    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:02.287763 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:02.287741    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ec9b43_75d9_4ccd_8f2a_fe417e4a9bbd.slice/crio-3e2e4037dfb46a27d7321dea36a833499cca12bf1e293ea1da6e69969eb66010 WatchSource:0}: Error finding container 3e2e4037dfb46a27d7321dea36a833499cca12bf1e293ea1da6e69969eb66010: Status 404 returned error can't find the container with id 3e2e4037dfb46a27d7321dea36a833499cca12bf1e293ea1da6e69969eb66010
Oct 30 16:19:02.289941 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.289912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:02.293127 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.293106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:02.294410 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:02.294382    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5806cd90_2896_488a_ac38_10fc6d959026.slice/crio-538fc6c88ee927324db73ef308984085f2aa25139f0b20fec72315d7468bb5a9 WatchSource:0}: Error finding container 538fc6c88ee927324db73ef308984085f2aa25139f0b20fec72315d7468bb5a9: Status 404 returned error can't find the container with id 538fc6c88ee927324db73ef308984085f2aa25139f0b20fec72315d7468bb5a9
Oct 30 16:19:02.295224 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.295205    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2clff"
Oct 30 16:19:02.305688 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.305524    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:02.305834 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:02.305812    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbdfeeb_7ea0_45a2_a0ba_a36cfdd65749.slice/crio-9fa913dabf362be3c185a12c28163cf454336c062705dd3388a9ab70be7c15f9 WatchSource:0}: Error finding container 9fa913dabf362be3c185a12c28163cf454336c062705dd3388a9ab70be7c15f9: Status 404 returned error can't find the container with id 9fa913dabf362be3c185a12c28163cf454336c062705dd3388a9ab70be7c15f9
Oct 30 16:19:02.309320 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:02.309295    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b373b2_2951_49d8_98a5_221c47b724c0.slice/crio-9b8a91ff6a74ffe62dd6cd94ce4920bab0f5b928414b3e0e88e778e922e4d05d WatchSource:0}: Error finding container 9b8a91ff6a74ffe62dd6cd94ce4920bab0f5b928414b3e0e88e778e922e4d05d: Status 404 returned error can't find the container with id 9b8a91ff6a74ffe62dd6cd94ce4920bab0f5b928414b3e0e88e778e922e4d05d
Oct 30 16:19:02.317524 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:02.317501    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e23d4f_4633_46b8_882f_3acabfb8a3f1.slice/crio-c18912c0f94b715c3267103571a0e4bba6c0c6c2fef7a458c7446570a655080e WatchSource:0}: Error finding container c18912c0f94b715c3267103571a0e4bba6c0c6c2fef7a458c7446570a655080e: Status 404 returned error can't find the container with id c18912c0f94b715c3267103571a0e4bba6c0c6c2fef7a458c7446570a655080e
Oct 30 16:19:02.381637 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.381604    2583 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:02.475306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.475227    2583 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:02.564852 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.564760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:02.564852 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.564833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:02.565031 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.564986    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:02.565069 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.565044    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret podName:fc642127-45e3-46e5-897f-93b899a68127 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:03.56502709 +0000 UTC m=+3.147785154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret") pod "global-pull-secret-syncer-4xnzd" (UID: "fc642127-45e3-46e5-897f-93b899a68127") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:02.565515 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.565375    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:02.565515 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.565445    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs podName:88847d7c-8749-4920-9c90-97f93bbfc432 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:03.565431695 +0000 UTC m=+3.148189744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs") pod "network-metrics-daemon-rttw4" (UID: "88847d7c-8749-4920-9c90-97f93bbfc432") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:02.665410 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.665349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:02.665565 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.665547    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:02.665605 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.665570    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:02.665605 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.665583    2583 projected.go:196] Error preparing data for projected volume kube-api-access-lwzmt for pod openshift-network-diagnostics/network-check-target-7c4px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:02.665703 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:02.665643    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt podName:7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:03.665625922 +0000 UTC m=+3.248383994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwzmt" (UniqueName: "kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt") pod "network-check-target-7c4px" (UID: "7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:02.936588 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.936514    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 16:14:02 +0000 UTC" deadline="2028-04-08 11:24:04.937781046 +0000 UTC"
Oct 30 16:19:02.936588 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.936587    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12619h5m2.001199192s"
Oct 30 16:19:02.971687 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.971616    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xl9bk" event={"ID":"8ac16845-91f4-48c7-a02c-84fedf86171d","Type":"ContainerStarted","Data":"f807fa47632726c046e6f82b99def2a4d97328e96c65f3f242dcb2986b5b1830"}
Oct 30 16:19:02.980760 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.980727    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"c18912c0f94b715c3267103571a0e4bba6c0c6c2fef7a458c7446570a655080e"}
Oct 30 16:19:02.984625 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:02.984592    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bvzgm" event={"ID":"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749","Type":"ContainerStarted","Data":"9fa913dabf362be3c185a12c28163cf454336c062705dd3388a9ab70be7c15f9"}
Oct 30 16:19:03.006599 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.006565    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4b9s" event={"ID":"37d06c87-6ddd-4605-9322-9e13e26eaaa4","Type":"ContainerStarted","Data":"5bc3e51aef3ab8db5a6575b7dc2dce6a3264a9caf95154f05f21ae42b9e8e12d"}
Oct 30 16:19:03.021116 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.021085    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9s5vn" event={"ID":"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd","Type":"ContainerStarted","Data":"3e2e4037dfb46a27d7321dea36a833499cca12bf1e293ea1da6e69969eb66010"}
Oct 30 16:19:03.036808 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.036778    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82qt4" event={"ID":"72030764-3f04-44d3-97fe-3d0da005a6a2","Type":"ContainerStarted","Data":"ec9104ba592f8b044d2ae4fc3dc4838dae4c4bf345a22b665efb1fec1636e605"}
Oct 30 16:19:03.060064 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.060032    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal" event={"ID":"5516ee241b7eda607841dfd15963de2b","Type":"ContainerStarted","Data":"7da9c9e54c0ce6ce7ce4b284f481d1036b6b47ce24b1b23829cacf57f82951ee"}
Oct 30 16:19:03.065588 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.065557    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal" event={"ID":"12fb9ae397c79a585da42d7d21f809ee","Type":"ContainerStarted","Data":"d7a199c4b6899687dc5a371143f408b5a1a1f5f3d6ac5160a5677795c4ae860e"}
Oct 30 16:19:03.069176 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.069153    2583 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:03.071473 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.071400    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2clff" event={"ID":"e5b373b2-2951-49d8-98a5-221c47b724c0","Type":"ContainerStarted","Data":"9b8a91ff6a74ffe62dd6cd94ce4920bab0f5b928414b3e0e88e778e922e4d05d"}
Oct 30 16:19:03.075002 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.074976    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" event={"ID":"5806cd90-2896-488a-ac38-10fc6d959026","Type":"ContainerStarted","Data":"538fc6c88ee927324db73ef308984085f2aa25139f0b20fec72315d7468bb5a9"}
Oct 30 16:19:03.077006 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.076980    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8" event={"ID":"5dcd8fb6-aaea-456a-bf39-c58f04323aee","Type":"ContainerStarted","Data":"1a9c91d9f6b201a2225c2b51bd9239b242acc35a9694e1300e8de9d2cfbfefa2"}
Oct 30 16:19:03.574903 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.573869    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:03.574903 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.573935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:03.574903 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.574058    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:03.574903 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.574123    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret podName:fc642127-45e3-46e5-897f-93b899a68127 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:05.57410352 +0000 UTC m=+5.156861582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret") pod "global-pull-secret-syncer-4xnzd" (UID: "fc642127-45e3-46e5-897f-93b899a68127") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:03.574903 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.574576    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:03.574903 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.574632    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs podName:88847d7c-8749-4920-9c90-97f93bbfc432 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:05.574614593 +0000 UTC m=+5.157372657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs") pod "network-metrics-daemon-rttw4" (UID: "88847d7c-8749-4920-9c90-97f93bbfc432") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:03.574903 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.574828    2583 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:03.674619 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.674545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:03.674777 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.674703    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:03.674777 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.674720    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:03.674777 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.674729    2583 projected.go:196] Error preparing data for projected volume kube-api-access-lwzmt for pod openshift-network-diagnostics/network-check-target-7c4px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:03.674950 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.674785    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt podName:7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:05.674766679 +0000 UTC m=+5.257524731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwzmt" (UniqueName: "kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt") pod "network-check-target-7c4px" (UID: "7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:03.925432 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.924622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:03.925432 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.924776    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:03.925432 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.925184    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:03.925432 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.925272    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:03.925432 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.925345    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:03.927495 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:03.926476    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:03.937653 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.937604    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 16:14:02 +0000 UTC" deadline="2028-07-18 07:13:11.654772226 +0000 UTC"
Oct 30 16:19:03.937653 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:03.937629    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15038h54m7.717146863s"
Oct 30 16:19:05.592729 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:05.592694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:05.593156 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:05.592760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:05.593156 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.592884    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:05.593156 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.592945    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs podName:88847d7c-8749-4920-9c90-97f93bbfc432 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:09.592927408 +0000 UTC m=+9.175685468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs") pod "network-metrics-daemon-rttw4" (UID: "88847d7c-8749-4920-9c90-97f93bbfc432") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:05.593156 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.593014    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:05.593156 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.593038    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret podName:fc642127-45e3-46e5-897f-93b899a68127 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:09.593031283 +0000 UTC m=+9.175789342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret") pod "global-pull-secret-syncer-4xnzd" (UID: "fc642127-45e3-46e5-897f-93b899a68127") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:05.693211 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:05.693108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:05.693381 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.693316    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:05.693381 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.693354    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:05.693381 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.693368    2583 projected.go:196] Error preparing data for projected volume kube-api-access-lwzmt for pod openshift-network-diagnostics/network-check-target-7c4px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:05.693554 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.693425    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt podName:7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:09.693407731 +0000 UTC m=+9.276165789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwzmt" (UniqueName: "kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt") pod "network-check-target-7c4px" (UID: "7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:05.924444 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:05.924418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:05.924571 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.924546    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:05.924656 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:05.924626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:05.925003 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.924710    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:05.925003 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:05.924831    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:05.925003 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:05.924966    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:06.102349 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:06.102295    2583 generic.go:356] "Generic (PLEG): container finished" podID="12fb9ae397c79a585da42d7d21f809ee" containerID="28f614d8efafd7d6f5da0b7f58efa2af636682564d55d7025caa8726feab9afa" exitCode=0
Oct 30 16:19:06.102503 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:06.102415    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal" event={"ID":"12fb9ae397c79a585da42d7d21f809ee","Type":"ContainerDied","Data":"28f614d8efafd7d6f5da0b7f58efa2af636682564d55d7025caa8726feab9afa"}
Oct 30 16:19:06.121536 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:06.121468    2583 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="43e7c14b41b98c43f580524cf860538f9b658e932b7001838cd638e71913a368" exitCode=0
Oct 30 16:19:06.121536 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:06.121518    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" event={"ID":"5806cd90-2896-488a-ac38-10fc6d959026","Type":"ContainerDied","Data":"43e7c14b41b98c43f580524cf860538f9b658e932b7001838cd638e71913a368"}
Oct 30 16:19:07.128304 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:07.128221    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bvzgm" event={"ID":"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749","Type":"ContainerStarted","Data":"0b136b7368a03acdd2ed517b837c6a76f577f62d7b1156a6c8385f06e70c4c2d"}
Oct 30 16:19:07.133934 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:07.133904    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal" event={"ID":"5516ee241b7eda607841dfd15963de2b","Type":"ContainerStarted","Data":"8dc8134a66a5bbec2c7166dfddda33870899c45823c50f4ccddf9b6eb09c0336"}
Oct 30 16:19:07.154417 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:07.154330    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal" event={"ID":"12fb9ae397c79a585da42d7d21f809ee","Type":"ContainerStarted","Data":"c0a089965b6b60dc9bae3c245731e006d5e8213ae648d48ee12efb08b9a7e137"}
Oct 30 16:19:07.207322 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:07.207255    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bvzgm" podStartSLOduration=1.9258421700000001 podStartE2EDuration="6.207236451s" totalImagesPullingTime="4.281394281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:07.169424073 +0000 UTC m=+6.752182143" watchObservedRunningTime="2026-10-30 16:19:07.207236451 +0000 UTC m=+6.789994522"
Oct 30 16:19:07.207567 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:07.207531    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal" podStartSLOduration=5.207522843 podStartE2EDuration="5.207522843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:07.206597759 +0000 UTC m=+6.789355830" watchObservedRunningTime="2026-10-30 16:19:07.207522843 +0000 UTC m=+6.790280913"
Oct 30 16:19:07.924239 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:07.924201    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:07.924239 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:07.924216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:07.924496 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:07.924366    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:07.924903 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:07.924613    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:07.924903 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:07.924729    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:07.924903 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:07.924800    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:08.161450 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:08.160708    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9s5vn" event={"ID":"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd","Type":"ContainerStarted","Data":"226fddb3f0bfc229077425aa3005f0024c6f082074c70bf1421a192fb3501de5"}
Oct 30 16:19:08.198033 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:08.197938    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal" podStartSLOduration=6.197919399 podStartE2EDuration="6.197919399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:07.24412153 +0000 UTC m=+6.826879601" watchObservedRunningTime="2026-10-30 16:19:08.197919399 +0000 UTC m=+7.780677470"
Oct 30 16:19:09.013676 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.013644    2583 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:09.014273 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.014251    2583 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:09.052495 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.052434    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9s5vn" podStartSLOduration=2.75209975 podStartE2EDuration="8.052417467s" totalImagesPullingTime="5.300317717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:08.199178984 +0000 UTC m=+7.781937055" watchObservedRunningTime="2026-10-30 16:19:09.052417467 +0000 UTC m=+8.635175536"
Oct 30 16:19:09.164891 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.164857    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8" event={"ID":"5dcd8fb6-aaea-456a-bf39-c58f04323aee","Type":"ContainerStarted","Data":"fa76b17e2ce4b168d61ff7af51c55e0ffbd10a33527e29a441b20c1a01ff9bd5"}
Oct 30 16:19:09.628771 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.628731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:09.628970 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.628820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:09.629037 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.628983    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:09.629085 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.629046    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs podName:88847d7c-8749-4920-9c90-97f93bbfc432 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:17.62902665 +0000 UTC m=+17.211784697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs") pod "network-metrics-daemon-rttw4" (UID: "88847d7c-8749-4920-9c90-97f93bbfc432") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:09.629457 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.629438    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:09.629548 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.629481    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret podName:fc642127-45e3-46e5-897f-93b899a68127 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:17.629470415 +0000 UTC m=+17.212228462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret") pod "global-pull-secret-syncer-4xnzd" (UID: "fc642127-45e3-46e5-897f-93b899a68127") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:09.730267 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.730186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:09.730503 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.730452    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:09.730503 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.730480    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:09.730503 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.730495    2583 projected.go:196] Error preparing data for projected volume kube-api-access-lwzmt for pod openshift-network-diagnostics/network-check-target-7c4px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:09.730656 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.730560    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt podName:7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:17.730539099 +0000 UTC m=+17.313297160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwzmt" (UniqueName: "kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt") pod "network-check-target-7c4px" (UID: "7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:09.914379 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.914351    2583 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 16:19:09.926467 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.926418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:09.926561 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.926532    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:09.926629 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.926602    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:09.926701 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.926680    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:09.926759 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:09.926746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:09.926836 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:09.926819    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:10.168878 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:10.168850    2583 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:10.169395 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:10.169315    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8" event={"ID":"5dcd8fb6-aaea-456a-bf39-c58f04323aee","Type":"ContainerStarted","Data":"ef89afc1b00be5b3570e5a5e119fc5ba0105fc5c7dbce9e718a1849876467d6c"}
Oct 30 16:19:10.913413 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:10.912652    2583 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T16:19:09.914373074Z","UUID":"bdcf106d-4074-4645-87e4-cb482092ea9e","Handler":null,"Name":"","Endpoint":""}
Oct 30 16:19:10.919140 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:10.918720    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 16:19:10.919140 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:10.918752    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 16:19:11.173473 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.173256    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4b9s" event={"ID":"37d06c87-6ddd-4605-9322-9e13e26eaaa4","Type":"ContainerStarted","Data":"7ee5b867b389f0689aebdde6b5d3993d06181145d8b9986f444ebb966989e280"}
Oct 30 16:19:11.175770 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.175743    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2clff" event={"ID":"e5b373b2-2951-49d8-98a5-221c47b724c0","Type":"ContainerStarted","Data":"3b335b61bd407746d3f9f1cc13ac48fc2ce1cd8312f0d4596658e2b68ff86f81"}
Oct 30 16:19:11.179699 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.179082    2583 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="d038e7a151950672e47659405079e3ed4dd301aec8192ff617ff5c86f640baf2" exitCode=0
Oct 30 16:19:11.179699 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.179123    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" event={"ID":"5806cd90-2896-488a-ac38-10fc6d959026","Type":"ContainerDied","Data":"d038e7a151950672e47659405079e3ed4dd301aec8192ff617ff5c86f640baf2"}
Oct 30 16:19:11.211671 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.211628    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-k4b9s" podStartSLOduration=1.6354179530000001 podStartE2EDuration="10.211615485s" totalImagesPullingTime="8.576197532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:11.211411395 +0000 UTC m=+10.794169464" watchObservedRunningTime="2026-10-30 16:19:11.211615485 +0000 UTC m=+10.794373554"
Oct 30 16:19:11.251450 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.251401    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-2clff" podStartSLOduration=2.371390996 podStartE2EDuration="10.251383315s" totalImagesPullingTime="7.879992319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:11.250583432 +0000 UTC m=+10.833341501" watchObservedRunningTime="2026-10-30 16:19:11.251383315 +0000 UTC m=+10.834141386"
Oct 30 16:19:11.924214 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.924178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:11.924214 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.924201    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:11.924429 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:11.924275    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:11.924429 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:11.924293    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:11.924429 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:11.924405    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:11.924570 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:11.924507    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:12.184483 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:12.184406    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8" event={"ID":"5dcd8fb6-aaea-456a-bf39-c58f04323aee","Type":"ContainerStarted","Data":"4514ab7a7b65faa1f9a0c50f230767debfbbbeba1422086040b1314ee512cc76"}
Oct 30 16:19:12.186865 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:12.186801    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xl9bk" event={"ID":"8ac16845-91f4-48c7-a02c-84fedf86171d","Type":"ContainerStarted","Data":"38cb17c76027e0342a3e865206ff22942650a12b1b5cec757c19dad6ddc8f559"}
Oct 30 16:19:12.263850 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:12.263787    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8" podStartSLOduration=2.867283549 podStartE2EDuration="11.263768089s" totalImagesPullingTime="8.39648454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:12.225106694 +0000 UTC m=+11.807864764" watchObservedRunningTime="2026-10-30 16:19:12.263768089 +0000 UTC m=+11.846526158"
Oct 30 16:19:13.190526 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:13.190484    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82qt4" event={"ID":"72030764-3f04-44d3-97fe-3d0da005a6a2","Type":"ContainerStarted","Data":"5f1ad1b237b538d52cb7b4cb8a7bf43f4a884735ce79874c49d2877777189b7f"}
Oct 30 16:19:13.192756 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:13.192726    2583 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="f37f4bcf71f13810bee53bd158b007018d82c6a73bf44d86a42f47e4f4e6e5bc" exitCode=0
Oct 30 16:19:13.193840 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:13.193818    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" event={"ID":"5806cd90-2896-488a-ac38-10fc6d959026","Type":"ContainerDied","Data":"f37f4bcf71f13810bee53bd158b007018d82c6a73bf44d86a42f47e4f4e6e5bc"}
Oct 30 16:19:13.230388 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:13.230333    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xl9bk" podStartSLOduration=3.895323218 podStartE2EDuration="12.230320799s" totalImagesPullingTime="8.334997581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:12.264051355 +0000 UTC m=+11.846809429" watchObservedRunningTime="2026-10-30 16:19:13.230320799 +0000 UTC m=+12.813078868"
Oct 30 16:19:13.271743 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:13.271680    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-82qt4" podStartSLOduration=2.018900158 podStartE2EDuration="12.271662595s" totalImagesPullingTime="10.252762437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:13.229829421 +0000 UTC m=+12.812587491" watchObservedRunningTime="2026-10-30 16:19:13.271662595 +0000 UTC m=+12.854420665"
Oct 30 16:19:13.925045 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:13.925010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:13.925186 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:13.925074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:13.925238 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:13.925195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:13.925238 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:13.925203    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:13.925371 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:13.925297    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:13.925428 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:13.925395    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:15.200299 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:15.200262    2583 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="1f8704cf0c166f19630443e476dfa05729a963b1dd608e53f1a62670d6ac7e94" exitCode=0
Oct 30 16:19:15.200299 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:15.200299    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" event={"ID":"5806cd90-2896-488a-ac38-10fc6d959026","Type":"ContainerDied","Data":"1f8704cf0c166f19630443e476dfa05729a963b1dd608e53f1a62670d6ac7e94"}
Oct 30 16:19:15.924944 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:15.924670    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:15.925095 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:15.924728    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:15.925095 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:15.925072    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:15.925188 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:15.925109    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:15.925188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:15.924728    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:15.925263 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:15.925201    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:17.693072 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:17.693049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:17.693384 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:17.693092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:17.693384 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.693186    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:17.693384 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.693243    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs podName:88847d7c-8749-4920-9c90-97f93bbfc432 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.693228509 +0000 UTC m=+33.275986583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs") pod "network-metrics-daemon-rttw4" (UID: "88847d7c-8749-4920-9c90-97f93bbfc432") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:17.693384 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.693190    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:17.693384 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.693279    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret podName:fc642127-45e3-46e5-897f-93b899a68127 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.693272486 +0000 UTC m=+33.276030580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret") pod "global-pull-secret-syncer-4xnzd" (UID: "fc642127-45e3-46e5-897f-93b899a68127") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:17.793664 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:17.793637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:17.793829 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.793811    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:17.793901 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.793835    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:17.793901 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.793850    2583 projected.go:196] Error preparing data for projected volume kube-api-access-lwzmt for pod openshift-network-diagnostics/network-check-target-7c4px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:17.793972 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.793903    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt podName:7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.793887223 +0000 UTC m=+33.376645285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwzmt" (UniqueName: "kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt") pod "network-check-target-7c4px" (UID: "7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:17.924959 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:17.924816    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:17.925045 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:17.924849    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:17.925080 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.925051    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:17.925116 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:17.924867    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:17.925116 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.925105    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:17.925186 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:17.925171    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:18.208398 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.208372    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:19:18.208750 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.208728    2583 generic.go:356] "Generic (PLEG): container finished" podID="10e23d4f-4633-46b8-882f-3acabfb8a3f1" containerID="2307f3940c1e9f31b56bc5dbec7081335f2eec7006bf435955aa401f63ac4ee6" exitCode=1
Oct 30 16:19:18.208818 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.208800    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"49a9b0a9c41f822d92792b814603af8c3209fd3d71aca9c855da3563eaa950ad"}
Oct 30 16:19:18.208880 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.208861    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"359f4b1a4f3cf236bb02b064cdfb296a6c148e127a2744033c885d0fd8468557"}
Oct 30 16:19:18.208920 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.208908    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"0a9993796ebfeaa2b95cf66d4363df34535df3198c8fabcdbb41bcf37239ec89"}
Oct 30 16:19:18.208955 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.208943    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"f8c384ae1a50a83a3cdb500ba768fcbe3c43ca0e3337550d67022335ab72721a"}
Oct 30 16:19:18.208990 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.208977    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerDied","Data":"2307f3940c1e9f31b56bc5dbec7081335f2eec7006bf435955aa401f63ac4ee6"}
Oct 30 16:19:18.209030 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.209017    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"7da61251909b24ad4b6091533a1c4db35286733a140a898683fd4cfdddf11739"}
Oct 30 16:19:18.211328 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.211304    2583 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="5fa75b9b6aebecfc62095c7768b22049b6c977458c53784d6f4194b1742711e5" exitCode=0
Oct 30 16:19:18.211427 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:18.211354    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" event={"ID":"5806cd90-2896-488a-ac38-10fc6d959026","Type":"ContainerDied","Data":"5fa75b9b6aebecfc62095c7768b22049b6c977458c53784d6f4194b1742711e5"}
Oct 30 16:19:19.216246 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:19.216206    2583 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="5e77c4fb1bae2123a0ab25e4408e8a1ddc850abd401d2defa4a47d1b3f7deb04" exitCode=0
Oct 30 16:19:19.216847 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:19.216270    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" event={"ID":"5806cd90-2896-488a-ac38-10fc6d959026","Type":"ContainerDied","Data":"5e77c4fb1bae2123a0ab25e4408e8a1ddc850abd401d2defa4a47d1b3f7deb04"}
Oct 30 16:19:19.924685 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:19.924650    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:19.924844 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:19.924650    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:19.924844 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:19.924778    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:19.924844 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:19.924832    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:19.924942 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:19.924752    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:19.924942 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:19.924893    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:20.221747 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:20.221665    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" event={"ID":"5806cd90-2896-488a-ac38-10fc6d959026","Type":"ContainerStarted","Data":"e5bf38d073064504c2280af405a1accd5c3401414a82a65bf7a4a3b3c1026c4e"}
Oct 30 16:19:20.224454 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:20.224435    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:19:20.224754 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:20.224736    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"34fd17da6249b297f0b22020155b82cdfd781984ddf5b2bc8630f1e65da6d30d"}
Oct 30 16:19:20.292269 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:20.292222    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dlcgr" podStartSLOduration=7.832547408 podStartE2EDuration="19.292208409s" totalImagesPullingTime="11.459661001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:20.291763978 +0000 UTC m=+19.874522060" watchObservedRunningTime="2026-10-30 16:19:20.292208409 +0000 UTC m=+19.874966477"
Oct 30 16:19:21.924100 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:21.924069    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:21.924100 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:21.924104    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:21.924100 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:21.924105    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:21.924730 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:21.924174    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:21.924730 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:21.924224    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:21.924730 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:21.924324    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:22.234979 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:22.234956    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:19:22.235368 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:22.235327    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"fdce2bddcc52815ac766901d09707753945ea3e2088254e69bdbbee9d1c32ba5"}
Oct 30 16:19:22.235647 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:22.235621    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:22.235760 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:22.235742    2583 scope.go:122] "RemoveContainer" containerID="2307f3940c1e9f31b56bc5dbec7081335f2eec7006bf435955aa401f63ac4ee6"
Oct 30 16:19:22.252458 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:22.252436    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:23.241465 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.241439    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:19:23.242246 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.241866    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" event={"ID":"10e23d4f-4633-46b8-882f-3acabfb8a3f1","Type":"ContainerStarted","Data":"5a9425d544f07cfd30f53f06d69056a9930df3e78613515f828170aa0a72ba42"}
Oct 30 16:19:23.242246 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.241944    2583 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:23.242246 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.242198    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:23.256938 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.256916    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:23.325591 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.325536    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" podStartSLOduration=7.054933118 podStartE2EDuration="22.325520416s" totalImagesPullingTime="15.270587298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:23.325303328 +0000 UTC m=+22.908061419" watchObservedRunningTime="2026-10-30 16:19:23.325520416 +0000 UTC m=+22.908278484"
Oct 30 16:19:23.904947 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.904917    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:23.905123 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.905073    2583 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:23.905632 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.905607    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:23.924683 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.924658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:23.924829 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.924687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:23.924829 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:23.924756    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:23.924829 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:23.924821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:23.924991 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:23.924913    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:23.925047 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:23.925024    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:24.242257 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:24.242175    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7c4px"]
Oct 30 16:19:24.242927 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:24.242906    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rttw4"]
Oct 30 16:19:24.244002 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:24.243982    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:24.244112 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:24.244019    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:24.244112 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:24.244061    2583 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:24.244248 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:24.244227    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:24.244636 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:24.244612    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:24.244734 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:24.244718    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4xnzd"]
Oct 30 16:19:24.244796 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:24.244779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:24.244856 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:24.244839    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:25.246313 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:25.246282    2583 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:25.924720 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:25.924687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:25.924720 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:25.924715    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:25.924970 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:25.924838    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:25.924970 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:25.924834    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:25.924970 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:25.924918    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:25.925117 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:25.924988    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:27.690405 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:27.690377    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:27.690882 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:27.690585    2583 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:27.700688 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:27.700652    2583 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" podUID="10e23d4f-4633-46b8-882f-3acabfb8a3f1" containerName="ovnkube-controller" probeResult="failure" output=""
Oct 30 16:19:27.708952 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:27.708926    2583 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs" podUID="10e23d4f-4633-46b8-882f-3acabfb8a3f1" containerName="ovnkube-controller" probeResult="failure" output=""
Oct 30 16:19:27.925000 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:27.924969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:27.925161 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:27.924970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:27.925161 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:27.925079    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c4px" podUID="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36"
Oct 30 16:19:27.925161 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:27.924970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:27.925161 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:27.925151    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xnzd" podUID="fc642127-45e3-46e5-897f-93b899a68127"
Oct 30 16:19:27.925298 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:27.925247    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rttw4" podUID="88847d7c-8749-4920-9c90-97f93bbfc432"
Oct 30 16:19:29.702689 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.702654    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeReady"
Oct 30 16:19:29.703080 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.702812    2583 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 16:19:29.755192 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.755155    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-95hdf"]
Oct 30 16:19:29.758470 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.758444    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s7lhf"]
Oct 30 16:19:29.758624 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.758530    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-95hdf"
Oct 30 16:19:29.761265 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.761245    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n4sp2"]
Oct 30 16:19:29.761400 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.761316    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-s7lhf"
Oct 30 16:19:29.764041 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.764023    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"]
Oct 30 16:19:29.764149 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.764134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-n4sp2"
Oct 30 16:19:29.766986 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.766968    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"]
Oct 30 16:19:29.767104 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.767085    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.770022 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.770004    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"]
Oct 30 16:19:29.770124 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.770108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.773701 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.773687    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7869764d77-758qx"]
Oct 30 16:19:29.773801 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.773787    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:29.776611 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.776592    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-zfp2k"]
Oct 30 16:19:29.776696 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.776664    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.779565 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.779549    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9f769b7d5-g6vn9"]
Oct 30 16:19:29.779635 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.779615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.782189 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.782173    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"]
Oct 30 16:19:29.782298 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.782284    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.784921 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.784904    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-768cfdff76-wxc2q"]
Oct 30 16:19:29.785093 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.785057    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"
Oct 30 16:19:29.790672 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.790653    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.791134 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.791113    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"]
Oct 30 16:19:29.791604 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.791586    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.791736 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.791628    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 16:19:29.791825 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.791797    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.791915 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.791891    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k4d4h\""
Oct 30 16:19:29.792100 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.791955    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jcj7b\""
Oct 30 16:19:29.792100 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.791980    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 16:19:29.798038 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.798015    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-mltnx\""
Oct 30 16:19:29.804675 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.797990    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.804801 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.800782    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"]
Oct 30 16:19:29.805097 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.800931    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:29.808493 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.808470    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"]
Oct 30 16:19:29.808654 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.808613    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:29.811636 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.811612    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"]
Oct 30 16:19:29.811747 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.811686    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.814729 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.814710    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l8nf9"]
Oct 30 16:19:29.814842 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.814825    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"
Oct 30 16:19:29.817873 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.817848    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rbczx"]
Oct 30 16:19:29.818006 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.817988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.821259 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.820886    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-95hdf"]
Oct 30 16:19:29.822581 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.822356    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:29.824497 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824477    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s7lhf"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824515    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n4sp2"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824538    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824559    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824580    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824601    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824619    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824639    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824662    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768cfdff76-wxc2q"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824682    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l8nf9"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824712    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-zfp2k"]
Oct 30 16:19:29.827616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.824988    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"]
Oct 30 16:19:29.828255 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.827740    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7869764d77-758qx"]
Oct 30 16:19:29.828804 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.828788    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9f769b7d5-g6vn9"]
Oct 30 16:19:29.829827 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.829809    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"]
Oct 30 16:19:29.830793 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.830768    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbczx"]
Oct 30 16:19:29.872504 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfwl6\" (UniqueName: \"kubernetes.io/projected/64de0045-bcde-40a0-938e-d2eeee30f20c-kube-api-access-pfwl6\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:29.872589 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64de0045-bcde-40a0-938e-d2eeee30f20c-cert\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:29.872589 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-tmp\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.872658 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ssmb\" (UniqueName: \"kubernetes.io/projected/3dd6c0df-eb3d-4433-839e-abdf00f47695-kube-api-access-7ssmb\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.872658 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.872712 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-serving-cert\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.872743 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-snapshots\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.872743 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhrmz\" (UniqueName: \"kubernetes.io/projected/bf184a45-b70e-4fd6-9435-821fbeb133ba-kube-api-access-zhrmz\") pod \"kas-connection-checker-685895c7c9-s7lhf\" (UID: \"bf184a45-b70e-4fd6-9435-821fbeb133ba\") " pod="kube-system/kas-connection-checker-685895c7c9-s7lhf"
Oct 30 16:19:29.872829 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t5zt\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.872862 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872844    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.872895 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.872895 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872875    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:29.872959 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f743ff-35c0-42c8-9ab1-422606471aa0-tmp-dir\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.873013 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.872968    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:29.873087 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.873141 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq84b\" (UniqueName: \"kubernetes.io/projected/17bcd7b8-e377-451f-809b-9887d5b937e2-kube-api-access-nq84b\") pod \"kas-connection-checker-685895c7c9-n4sp2\" (UID: \"17bcd7b8-e377-451f-809b-9887d5b937e2\") " pod="kube-system/kas-connection-checker-685895c7c9-n4sp2"
Oct 30 16:19:29.873141 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwt8q\" (UniqueName: \"kubernetes.io/projected/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-kube-api-access-mwt8q\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.873238 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.873238 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873227    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.873307 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873261    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-default-certificate\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.873307 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2xq6\" (UniqueName: \"kubernetes.io/projected/41c538db-7de5-4e4d-ba29-d329164990cd-kube-api-access-s2xq6\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:29.873388 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/41c538db-7de5-4e4d-ba29-d329164990cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:29.873440 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.873440 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p56j6\" (UniqueName: \"kubernetes.io/projected/d28bb413-77af-4b21-9ee8-489c521b4603-kube-api-access-p56j6\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.873507 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.873507 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dd6c0df-eb3d-4433-839e-abdf00f47695-config\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.873581 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-trusted-ca\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.873581 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thd4n\" (UniqueName: \"kubernetes.io/projected/b232f810-709e-4360-9d38-3e968590bb08-kube-api-access-thd4n\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:29.873667 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873583    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.873667 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f1110bc-3087-4f49-9e1c-5371b8c85d09-nginx-conf\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:29.873667 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873653    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.873813 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.873813 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873726    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.873813 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.873813 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30f743ff-35c0-42c8-9ab1-422606471aa0-config-volume\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.873813 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dd6c0df-eb3d-4433-839e-abdf00f47695-serving-cert\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.873970 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.873970 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.873970 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hftk2\" (UniqueName: \"kubernetes.io/projected/a64c6e47-3cf0-4453-b3e6-2657a66813e8-kube-api-access-hftk2\") pod \"network-check-source-6f78d59f99-8bw88\" (UID: \"a64c6e47-3cf0-4453-b3e6-2657a66813e8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"
Oct 30 16:19:29.873970 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873966    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn92z\" (UniqueName: \"kubernetes.io/projected/52e59496-41f2-430d-8c96-467b3ef3a839-kube-api-access-jn92z\") pod \"volume-data-source-validator-58c9f5f46d-gczng\" (UID: \"52e59496-41f2-430d-8c96-467b3ef3a839\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"
Oct 30 16:19:29.874121 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.873990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:29.874121 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-config\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.874121 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.874121 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:29.874121 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-stats-auth\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.874315 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.874315 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz7cw\" (UniqueName: \"kubernetes.io/projected/c6f74c24-d57d-4296-b70d-631bd8eac394-kube-api-access-zz7cw\") pod \"kas-connection-checker-685895c7c9-95hdf\" (UID: \"c6f74c24-d57d-4296-b70d-631bd8eac394\") " pod="kube-system/kas-connection-checker-685895c7c9-95hdf"
Oct 30 16:19:29.874315 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-service-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.874315 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.874315 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d28bb413-77af-4b21-9ee8-489c521b4603-serving-cert\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.874550 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.874550 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874387    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.874550 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwjz\" (UniqueName: \"kubernetes.io/projected/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-kube-api-access-cjwjz\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.874550 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmhzz\" (UniqueName: \"kubernetes.io/projected/30f743ff-35c0-42c8-9ab1-422606471aa0-kube-api-access-lmhzz\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.874550 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqzz7\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.874705 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.874554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7l8l\" (UniqueName: \"kubernetes.io/projected/fcb660ae-8c6a-42ec-bd90-484b9497250b-kube-api-access-f7l8l\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.877145 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.877124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:29.896108 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896080    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.896108 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896081    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.896280 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896138    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 16:19:29.896280 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896145    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.896280 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896166    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 16:19:29.896280 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896255    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.896280 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896278    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.896491 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896329    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.896491 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896350    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 16:19:29.896491 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896334    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.896491 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896441    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.896640 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896538    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.896640 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896544    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.896640 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896559    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 16:19:29.896640 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896572    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.896742 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896646    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.896837 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896819    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.896911 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896862    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.896911 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896863    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 16:19:29.896911 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896888    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 16:19:29.896911 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.896866    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 16:19:29.897110 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897092    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.897163 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897093    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 16:19:29.897163 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897093    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.897163 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897119    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.897163 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897138    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:29.897396 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897372    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 16:19:29.897499 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897459    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 16:19:29.897499 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897459    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 16:19:29.897595 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897566    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 16:19:29.897770 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897756    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 16:19:29.897824 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897802    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 16:19:29.897957 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897939    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:29.898026 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897972    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 16:19:29.898026 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.897982    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 16:19:29.898026 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.898017    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 16:19:29.898163 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.898032    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 16:19:29.898163 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.898130    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 16:19:29.898818 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.898791    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 16:19:29.898900 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.898799    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sqdm6\""
Oct 30 16:19:29.908450 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.908426    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mzzhs\""
Oct 30 16:19:29.908772 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.908753    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tbf7f\""
Oct 30 16:19:29.908909 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.908897    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7g4mc\""
Oct 30 16:19:29.908971 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.908961    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-njwx4\""
Oct 30 16:19:29.909021 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.908963    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rqh77\""
Oct 30 16:19:29.909072 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.909027    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mzplq\""
Oct 30 16:19:29.909459 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.909442    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-zr2xc\""
Oct 30 16:19:29.909518 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.909500    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7jjq4\""
Oct 30 16:19:29.909518 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.909505    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d8hpm\""
Oct 30 16:19:29.910320 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.910299    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 16:19:29.910565 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.910548    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 16:19:29.922380 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.922324    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 16:19:29.922942 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.922920    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 16:19:29.923011 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.922947    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 16:19:29.924697 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.924681    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:29.924742 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.924715    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:29.924795 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.924681    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:29.975848 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.975771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:29.975848 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.975801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.975848 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.975819    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq84b\" (UniqueName: \"kubernetes.io/projected/17bcd7b8-e377-451f-809b-9887d5b937e2-kube-api-access-nq84b\") pod \"kas-connection-checker-685895c7c9-n4sp2\" (UID: \"17bcd7b8-e377-451f-809b-9887d5b937e2\") " pod="kube-system/kas-connection-checker-685895c7c9-n4sp2"
Oct 30 16:19:29.975848 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.975836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwt8q\" (UniqueName: \"kubernetes.io/projected/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-kube-api-access-mwt8q\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.976136 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.975858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.976136 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.975940    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:29.976136 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.976010    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:30.475990483 +0000 UTC m=+30.058748555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:29.976136 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.976136 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-default-certificate\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.976136 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976083    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2xq6\" (UniqueName: \"kubernetes.io/projected/41c538db-7de5-4e4d-ba29-d329164990cd-kube-api-access-s2xq6\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:29.976136 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/41c538db-7de5-4e4d-ba29-d329164990cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:29.976136 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p56j6\" (UniqueName: \"kubernetes.io/projected/d28bb413-77af-4b21-9ee8-489c521b4603-kube-api-access-p56j6\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dd6c0df-eb3d-4433-839e-abdf00f47695-config\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-trusted-ca\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thd4n\" (UniqueName: \"kubernetes.io/projected/b232f810-709e-4360-9d38-3e968590bb08-kube-api-access-thd4n\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f1110bc-3087-4f49-9e1c-5371b8c85d09-nginx-conf\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.976441 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30f743ff-35c0-42c8-9ab1-422606471aa0-config-volume\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dd6c0df-eb3d-4433-839e-abdf00f47695-serving-cert\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976520    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hftk2\" (UniqueName: \"kubernetes.io/projected/a64c6e47-3cf0-4453-b3e6-2657a66813e8-kube-api-access-hftk2\") pod \"network-check-source-6f78d59f99-8bw88\" (UID: \"a64c6e47-3cf0-4453-b3e6-2657a66813e8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn92z\" (UniqueName: \"kubernetes.io/projected/52e59496-41f2-430d-8c96-467b3ef3a839-kube-api-access-jn92z\") pod \"volume-data-source-validator-58c9f5f46d-gczng\" (UID: \"52e59496-41f2-430d-8c96-467b3ef3a839\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976659    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-config\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.976754    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:29.976843 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.976803    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls podName:41c538db-7de5-4e4d-ba29-d329164990cd nodeName:}" failed. No retries permitted until 2026-10-30 16:19:30.476787048 +0000 UTC m=+30.059545110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5knxh" (UID: "41c538db-7de5-4e4d-ba29-d329164990cd") : secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:29.977485 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976896    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.977485 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976922    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dd6c0df-eb3d-4433-839e-abdf00f47695-config\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.977485 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977068    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.977485 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977171    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/41c538db-7de5-4e4d-ba29-d329164990cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:29.977485 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977332    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.977485 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.977467    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:30.477451943 +0000 UTC m=+30.060209993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:29.977780 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.977509    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:29.977780 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.977522    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768cfdff76-wxc2q: secret "image-registry-tls" not found
Oct 30 16:19:29.977780 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.977567    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls podName:4b6aeef2-7878-466d-964c-2a375bdb8f04 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:30.477554703 +0000 UTC m=+30.060312768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls") pod "image-registry-768cfdff76-wxc2q" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04") : secret "image-registry-tls" not found
Oct 30 16:19:29.977780 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977594    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.977780 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.977628    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:29.977780 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.977639    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869764d77-758qx: secret "image-registry-tls" not found
Oct 30 16:19:29.977780 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.977669    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls podName:afdf3517-540a-470f-b111-043df8f007c5 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:30.477658767 +0000 UTC m=+30.060416829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls") pod "image-registry-7869764d77-758qx" (UID: "afdf3517-540a-470f-b111-043df8f007c5") : secret "image-registry-tls" not found
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977801    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-config\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977869    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-trusted-ca\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.976750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-stats-auth\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.977998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz7cw\" (UniqueName: \"kubernetes.io/projected/c6f74c24-d57d-4296-b70d-631bd8eac394-kube-api-access-zz7cw\") pod \"kas-connection-checker-685895c7c9-95hdf\" (UID: \"c6f74c24-d57d-4296-b70d-631bd8eac394\") " pod="kube-system/kas-connection-checker-685895c7c9-95hdf"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-service-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978065    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f1110bc-3087-4f49-9e1c-5371b8c85d09-nginx-conf\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d28bb413-77af-4b21-9ee8-489c521b4603-serving-cert\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.978128 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.978186    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.978239    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert podName:9f1110bc-3087-4f49-9e1c-5371b8c85d09 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:30.478226392 +0000 UTC m=+30.060984440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-kjxhd" (UID: "9f1110bc-3087-4f49-9e1c-5371b8c85d09") : secret "networking-console-plugin-cert" not found
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978286    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwjz\" (UniqueName: \"kubernetes.io/projected/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-kube-api-access-cjwjz\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhzz\" (UniqueName: \"kubernetes.io/projected/30f743ff-35c0-42c8-9ab1-422606471aa0-kube-api-access-lmhzz\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqzz7\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7l8l\" (UniqueName: \"kubernetes.io/projected/fcb660ae-8c6a-42ec-bd90-484b9497250b-kube-api-access-f7l8l\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwl6\" (UniqueName: \"kubernetes.io/projected/64de0045-bcde-40a0-938e-d2eeee30f20c-kube-api-access-pfwl6\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64de0045-bcde-40a0-938e-d2eeee30f20c-cert\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-tmp\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ssmb\" (UniqueName: \"kubernetes.io/projected/3dd6c0df-eb3d-4433-839e-abdf00f47695-kube-api-access-7ssmb\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-serving-cert\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-snapshots\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978610    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.978703 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhrmz\" (UniqueName: \"kubernetes.io/projected/bf184a45-b70e-4fd6-9435-821fbeb133ba-kube-api-access-zhrmz\") pod \"kas-connection-checker-685895c7c9-s7lhf\" (UID: \"bf184a45-b70e-4fd6-9435-821fbeb133ba\") " pod="kube-system/kas-connection-checker-685895c7c9-s7lhf"
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5zt\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.978776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f743ff-35c0-42c8-9ab1-422606471aa0-tmp-dir\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.979024    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30f743ff-35c0-42c8-9ab1-422606471aa0-config-volume\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.979088    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f743ff-35c0-42c8-9ab1-422606471aa0-tmp-dir\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.979164    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 16:19:29.979457 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.979201    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls podName:30f743ff-35c0-42c8-9ab1-422606471aa0 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:30.47918871 +0000 UTC m=+30.061946757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls") pod "dns-default-l8nf9" (UID: "30f743ff-35c0-42c8-9ab1-422606471aa0") : secret "dns-default-metrics-tls" not found
Oct 30 16:19:29.979893 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.979632    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-service-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.980412 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.980392    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-snapshots\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.980940 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.980415    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 16:19:29.981114 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:29.981101    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:30.481086291 +0000 UTC m=+30.063844343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : secret "router-metrics-certs-default" not found
Oct 30 16:19:29.981206 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.980965    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-tmp\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.981473 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.981450    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.982219 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.982195    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:29.982364 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.982300    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dd6c0df-eb3d-4433-839e-abdf00f47695-serving-cert\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:29.982477 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.982307    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.982581 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.982507    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:29.982748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.982724    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.983231 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.983206    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d28bb413-77af-4b21-9ee8-489c521b4603-serving-cert\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:29.983354 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.983286    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-default-certificate\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.983423 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.983395    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.983683 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.983653    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-stats-auth\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:29.983773 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.983742    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-serving-cert\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:29.983834 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.983822    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:29.984135 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.984110    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:29.984857 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.984839    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64de0045-bcde-40a0-938e-d2eeee30f20c-cert\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:29.991662 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.991640    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 16:19:29.991796 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.991767    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-bhx7q\""
Oct 30 16:19:29.991856 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.991842    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2ph4\""
Oct 30 16:19:29.991890 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.991870    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 16:19:29.991950 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:29.991937    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-t25rz\""
Oct 30 16:19:30.011751 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.011718    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwt8q\" (UniqueName: \"kubernetes.io/projected/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-kube-api-access-mwt8q\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:30.012885 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.012856    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ssmb\" (UniqueName: \"kubernetes.io/projected/3dd6c0df-eb3d-4433-839e-abdf00f47695-kube-api-access-7ssmb\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:30.013619 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.013155    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwjz\" (UniqueName: \"kubernetes.io/projected/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-kube-api-access-cjwjz\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:30.013619 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.013159    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56j6\" (UniqueName: \"kubernetes.io/projected/d28bb413-77af-4b21-9ee8-489c521b4603-kube-api-access-p56j6\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:30.013619 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.013380    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:30.013619 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.013547    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq84b\" (UniqueName: \"kubernetes.io/projected/17bcd7b8-e377-451f-809b-9887d5b937e2-kube-api-access-nq84b\") pod \"kas-connection-checker-685895c7c9-n4sp2\" (UID: \"17bcd7b8-e377-451f-809b-9887d5b937e2\") " pod="kube-system/kas-connection-checker-685895c7c9-n4sp2"
Oct 30 16:19:30.013838 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.013691    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn92z\" (UniqueName: \"kubernetes.io/projected/52e59496-41f2-430d-8c96-467b3ef3a839-kube-api-access-jn92z\") pod \"volume-data-source-validator-58c9f5f46d-gczng\" (UID: \"52e59496-41f2-430d-8c96-467b3ef3a839\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"
Oct 30 16:19:30.014306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.014019    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz7cw\" (UniqueName: \"kubernetes.io/projected/c6f74c24-d57d-4296-b70d-631bd8eac394-kube-api-access-zz7cw\") pod \"kas-connection-checker-685895c7c9-95hdf\" (UID: \"c6f74c24-d57d-4296-b70d-631bd8eac394\") " pod="kube-system/kas-connection-checker-685895c7c9-95hdf"
Oct 30 16:19:30.014451 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.014429    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2xq6\" (UniqueName: \"kubernetes.io/projected/41c538db-7de5-4e4d-ba29-d329164990cd-kube-api-access-s2xq6\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:30.015536 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.015512    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hftk2\" (UniqueName: \"kubernetes.io/projected/a64c6e47-3cf0-4453-b3e6-2657a66813e8-kube-api-access-hftk2\") pod \"network-check-source-6f78d59f99-8bw88\" (UID: \"a64c6e47-3cf0-4453-b3e6-2657a66813e8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"
Oct 30 16:19:30.015679 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.015655    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhzz\" (UniqueName: \"kubernetes.io/projected/30f743ff-35c0-42c8-9ab1-422606471aa0-kube-api-access-lmhzz\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:30.016778 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.016737    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:30.016884 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.016825    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhrmz\" (UniqueName: \"kubernetes.io/projected/bf184a45-b70e-4fd6-9435-821fbeb133ba-kube-api-access-zhrmz\") pod \"kas-connection-checker-685895c7c9-s7lhf\" (UID: \"bf184a45-b70e-4fd6-9435-821fbeb133ba\") " pod="kube-system/kas-connection-checker-685895c7c9-s7lhf"
Oct 30 16:19:30.016884 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.016846    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqzz7\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:30.017595 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.017576    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thd4n\" (UniqueName: \"kubernetes.io/projected/b232f810-709e-4360-9d38-3e968590bb08-kube-api-access-thd4n\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:30.017774 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.017756    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t5zt\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:30.020839 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.020820    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7l8l\" (UniqueName: \"kubernetes.io/projected/fcb660ae-8c6a-42ec-bd90-484b9497250b-kube-api-access-f7l8l\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:30.021791 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.021771    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwl6\" (UniqueName: \"kubernetes.io/projected/64de0045-bcde-40a0-938e-d2eeee30f20c-kube-api-access-pfwl6\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:30.072567 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.072533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-95hdf"
Oct 30 16:19:30.076941 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.076914    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-s7lhf"
Oct 30 16:19:30.083416 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.083390    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-n4sp2"
Oct 30 16:19:30.091474 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.091439    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:30.096951 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.096923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:30.109672 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.109608    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:30.134372 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.134056    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:30.147450 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.147211    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"
Oct 30 16:19:30.170951 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.170733    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:30.176650 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.176599    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"
Oct 30 16:19:30.187515 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.187460    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:30.389908 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.389884    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-95hdf"]
Oct 30 16:19:30.391666 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.391629    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f74c24_d57d_4296_b70d_631bd8eac394.slice/crio-60021494faea99c67a259ce5d5dfc419c7a1fa8ee0f0efd544436098df728a87 WatchSource:0}: Error finding container 60021494faea99c67a259ce5d5dfc419c7a1fa8ee0f0efd544436098df728a87: Status 404 returned error can't find the container with id 60021494faea99c67a259ce5d5dfc419c7a1fa8ee0f0efd544436098df728a87
Oct 30 16:19:30.395649 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.394600    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s7lhf"]
Oct 30 16:19:30.395649 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.395589    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf184a45_b70e_4fd6_9435_821fbeb133ba.slice/crio-72d0587f87aed62b45d0c825a89092a1f4a07253ae993565b5ccaad3893d8521 WatchSource:0}: Error finding container 72d0587f87aed62b45d0c825a89092a1f4a07253ae993565b5ccaad3893d8521: Status 404 returned error can't find the container with id 72d0587f87aed62b45d0c825a89092a1f4a07253ae993565b5ccaad3893d8521
Oct 30 16:19:30.409482 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.409460    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-n4sp2"]
Oct 30 16:19:30.411532 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.411495    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bcd7b8_e377_451f_809b_9887d5b937e2.slice/crio-0e3b7e2c04d7fda3dabd74c61789b3fba225f3f48479fa3dd7785dfc0024e46a WatchSource:0}: Error finding container 0e3b7e2c04d7fda3dabd74c61789b3fba225f3f48479fa3dd7785dfc0024e46a: Status 404 returned error can't find the container with id 0e3b7e2c04d7fda3dabd74c61789b3fba225f3f48479fa3dd7785dfc0024e46a
Oct 30 16:19:30.429296 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.429275    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"]
Oct 30 16:19:30.432330 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.432302    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659d22c7_e8bf_48e3_a6e8_54f4e2e77cea.slice/crio-5cb59c3405e961cf93da617bc6bb669f227669021f0e662ca734bd0f8a9ae19a WatchSource:0}: Error finding container 5cb59c3405e961cf93da617bc6bb669f227669021f0e662ca734bd0f8a9ae19a: Status 404 returned error can't find the container with id 5cb59c3405e961cf93da617bc6bb669f227669021f0e662ca734bd0f8a9ae19a
Oct 30 16:19:30.458526 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.458487    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"]
Oct 30 16:19:30.460650 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.460613    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b9aacd_cd48_4496_a43a_ce89ff7a29fa.slice/crio-1a9dbaff1ffd908b9d83c5f87409074f2ad2e55f77beafcdf152705fbd41bf5f WatchSource:0}: Error finding container 1a9dbaff1ffd908b9d83c5f87409074f2ad2e55f77beafcdf152705fbd41bf5f: Status 404 returned error can't find the container with id 1a9dbaff1ffd908b9d83c5f87409074f2ad2e55f77beafcdf152705fbd41bf5f
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.485530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.485607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.485640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.485670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.485701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.485735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.485766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.485806    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486002    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486059    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls podName:30f743ff-35c0-42c8-9ab1-422606471aa0 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:31.486041562 +0000 UTC m=+31.068799626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls") pod "dns-default-l8nf9" (UID: "30f743ff-35c0-42c8-9ab1-422606471aa0") : secret "dns-default-metrics-tls" not found
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486119    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486152    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:31.486141716 +0000 UTC m=+31.068899763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486217    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:31.486206536 +0000 UTC m=+31.068964585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486277    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:30.486735 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486288    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768cfdff76-wxc2q: secret "image-registry-tls" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486315    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls podName:4b6aeef2-7878-466d-964c-2a375bdb8f04 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:31.486306591 +0000 UTC m=+31.069064639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls") pod "image-registry-768cfdff76-wxc2q" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04") : secret "image-registry-tls" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486389    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486399    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869764d77-758qx: secret "image-registry-tls" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486428    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls podName:afdf3517-540a-470f-b111-043df8f007c5 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:31.486418943 +0000 UTC m=+31.069176994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls") pod "image-registry-7869764d77-758qx" (UID: "afdf3517-540a-470f-b111-043df8f007c5") : secret "image-registry-tls" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486481    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486510    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls podName:41c538db-7de5-4e4d-ba29-d329164990cd nodeName:}" failed. No retries permitted until 2026-10-30 16:19:31.486501138 +0000 UTC m=+31.069259184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5knxh" (UID: "41c538db-7de5-4e4d-ba29-d329164990cd") : secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486564    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486594    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert podName:9f1110bc-3087-4f49-9e1c-5371b8c85d09 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:31.48658364 +0000 UTC m=+31.069341689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-kjxhd" (UID: "9f1110bc-3087-4f49-9e1c-5371b8c85d09") : secret "networking-console-plugin-cert" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486644    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 16:19:30.487845 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:30.486670    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:31.486661703 +0000 UTC m=+31.069419752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : secret "router-metrics-certs-default" not found
Oct 30 16:19:30.491366 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.491280    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-zfp2k"]
Oct 30 16:19:30.494113 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.494077    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28bb413_77af_4b21_9ee8_489c521b4603.slice/crio-9283917c899282cf2576c5b0bb37d5a312004bfa485a043f0312080974ab45f6 WatchSource:0}: Error finding container 9283917c899282cf2576c5b0bb37d5a312004bfa485a043f0312080974ab45f6: Status 404 returned error can't find the container with id 9283917c899282cf2576c5b0bb37d5a312004bfa485a043f0312080974ab45f6
Oct 30 16:19:30.523970 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.523412    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"]
Oct 30 16:19:30.530792 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.529869    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e59496_41f2_430d_8c96_467b3ef3a839.slice/crio-3fb1fc6577a596f525550cdb6fe7e9d3b25c228ff303fdb46008002228c3b2be WatchSource:0}: Error finding container 3fb1fc6577a596f525550cdb6fe7e9d3b25c228ff303fdb46008002228c3b2be: Status 404 returned error can't find the container with id 3fb1fc6577a596f525550cdb6fe7e9d3b25c228ff303fdb46008002228c3b2be
Oct 30 16:19:30.560211 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.560181    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"]
Oct 30 16:19:30.561139 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.561116    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64c6e47_3cf0_4453_b3e6_2657a66813e8.slice/crio-0b26104cdf7e8270b1eaa4fb0491c726cac32f0eb3f50ebf4fd8501e14ad6a0c WatchSource:0}: Error finding container 0b26104cdf7e8270b1eaa4fb0491c726cac32f0eb3f50ebf4fd8501e14ad6a0c: Status 404 returned error can't find the container with id 0b26104cdf7e8270b1eaa4fb0491c726cac32f0eb3f50ebf4fd8501e14ad6a0c
Oct 30 16:19:30.573642 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.573617    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbczx"]
Oct 30 16:19:30.575208 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.575183    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64de0045_bcde_40a0_938e_d2eeee30f20c.slice/crio-162586301f0fea5cf3bda7b123888ed26870f412cabdf7bddfb130a2f5877e3e WatchSource:0}: Error finding container 162586301f0fea5cf3bda7b123888ed26870f412cabdf7bddfb130a2f5877e3e: Status 404 returned error can't find the container with id 162586301f0fea5cf3bda7b123888ed26870f412cabdf7bddfb130a2f5877e3e
Oct 30 16:19:30.588824 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:30.588805    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"]
Oct 30 16:19:30.589595 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:30.589578    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd6c0df_eb3d_4433_839e_abdf00f47695.slice/crio-18405f154efaa4d5a42ba294e4847a893ecf2fb1a38bc5ce2333dac77487eada WatchSource:0}: Error finding container 18405f154efaa4d5a42ba294e4847a893ecf2fb1a38bc5ce2333dac77487eada: Status 404 returned error can't find the container with id 18405f154efaa4d5a42ba294e4847a893ecf2fb1a38bc5ce2333dac77487eada
Oct 30 16:19:31.267260 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.267206    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw" event={"ID":"3dd6c0df-eb3d-4433-839e-abdf00f47695","Type":"ContainerStarted","Data":"18405f154efaa4d5a42ba294e4847a893ecf2fb1a38bc5ce2333dac77487eada"}
Oct 30 16:19:31.269136 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.269109    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8" event={"ID":"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea","Type":"ContainerStarted","Data":"5cb59c3405e961cf93da617bc6bb669f227669021f0e662ca734bd0f8a9ae19a"}
Oct 30 16:19:31.272768 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.272743    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-95hdf" event={"ID":"c6f74c24-d57d-4296-b70d-631bd8eac394","Type":"ContainerStarted","Data":"3ee6d9e3f56120d7d07e5484142d9a5555ea1fcd48fb7a6deb65334f80e84166"}
Oct 30 16:19:31.272882 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.272787    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-95hdf" event={"ID":"c6f74c24-d57d-4296-b70d-631bd8eac394","Type":"ContainerStarted","Data":"60021494faea99c67a259ce5d5dfc419c7a1fa8ee0f0efd544436098df728a87"}
Oct 30 16:19:31.275149 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.275125    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbczx" event={"ID":"64de0045-bcde-40a0-938e-d2eeee30f20c","Type":"ContainerStarted","Data":"162586301f0fea5cf3bda7b123888ed26870f412cabdf7bddfb130a2f5877e3e"}
Oct 30 16:19:31.276466 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.276439    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4" event={"ID":"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa","Type":"ContainerStarted","Data":"1a9dbaff1ffd908b9d83c5f87409074f2ad2e55f77beafcdf152705fbd41bf5f"}
Oct 30 16:19:31.278504 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.278480    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng" event={"ID":"52e59496-41f2-430d-8c96-467b3ef3a839","Type":"ContainerStarted","Data":"3fb1fc6577a596f525550cdb6fe7e9d3b25c228ff303fdb46008002228c3b2be"}
Oct 30 16:19:31.281303 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.281278    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-zfp2k" event={"ID":"d28bb413-77af-4b21-9ee8-489c521b4603","Type":"ContainerStarted","Data":"9283917c899282cf2576c5b0bb37d5a312004bfa485a043f0312080974ab45f6"}
Oct 30 16:19:31.284554 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.284530    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-n4sp2" event={"ID":"17bcd7b8-e377-451f-809b-9887d5b937e2","Type":"ContainerStarted","Data":"76f79b7ed12da2c10bde6ef5d736179f3c78b9a0589e3550f0c3b6ba751bf5c0"}
Oct 30 16:19:31.284645 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.284576    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-n4sp2" event={"ID":"17bcd7b8-e377-451f-809b-9887d5b937e2","Type":"ContainerStarted","Data":"0e3b7e2c04d7fda3dabd74c61789b3fba225f3f48479fa3dd7785dfc0024e46a"}
Oct 30 16:19:31.286271 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.286218    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88" event={"ID":"a64c6e47-3cf0-4453-b3e6-2657a66813e8","Type":"ContainerStarted","Data":"0b26104cdf7e8270b1eaa4fb0491c726cac32f0eb3f50ebf4fd8501e14ad6a0c"}
Oct 30 16:19:31.290787 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.290199    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-s7lhf" event={"ID":"bf184a45-b70e-4fd6-9435-821fbeb133ba","Type":"ContainerStarted","Data":"5e9c37b77053543faa27357cf15a32e5fc021cb8de0aad81fbb7eefa5683b87b"}
Oct 30 16:19:31.290787 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.290240    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-s7lhf" event={"ID":"bf184a45-b70e-4fd6-9435-821fbeb133ba","Type":"ContainerStarted","Data":"72d0587f87aed62b45d0c825a89092a1f4a07253ae993565b5ccaad3893d8521"}
Oct 30 16:19:31.315645 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.315588    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-95hdf" podStartSLOduration=184.315572462 podStartE2EDuration="3m4.315572462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:31.313923949 +0000 UTC m=+30.896682019" watchObservedRunningTime="2026-10-30 16:19:31.315572462 +0000 UTC m=+30.898330532"
Oct 30 16:19:31.360038 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.359978    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-n4sp2" podStartSLOduration=184.359959716 podStartE2EDuration="3m4.359959716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:31.35908629 +0000 UTC m=+30.941844360" watchObservedRunningTime="2026-10-30 16:19:31.359959716 +0000 UTC m=+30.942717788"
Oct 30 16:19:31.399674 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.399619    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-s7lhf" podStartSLOduration=184.399599918 podStartE2EDuration="3m4.399599918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:31.399116683 +0000 UTC m=+30.981874754" watchObservedRunningTime="2026-10-30 16:19:31.399599918 +0000 UTC m=+30.982357988"
Oct 30 16:19:31.496228 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.496145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:31.496401 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496318    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:31.496401 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.496316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:31.496532 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496404    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.496386075 +0000 UTC m=+33.079144139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:31.496532 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496481    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.496466557 +0000 UTC m=+33.079224604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:31.496532 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.496515    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:31.496692 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.496547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:31.496692 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.496582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:31.496692 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.496612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:31.496692 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.496644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:31.496692 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:31.496680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:31.496930 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496814    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:31.496930 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496838    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 16:19:31.496930 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496860    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls podName:41c538db-7de5-4e4d-ba29-d329164990cd nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.496845236 +0000 UTC m=+33.079603489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5knxh" (UID: "41c538db-7de5-4e4d-ba29-d329164990cd") : secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:31.496930 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496877    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls podName:30f743ff-35c0-42c8-9ab1-422606471aa0 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.496867763 +0000 UTC m=+33.079625815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls") pod "dns-default-l8nf9" (UID: "30f743ff-35c0-42c8-9ab1-422606471aa0") : secret "dns-default-metrics-tls" not found
Oct 30 16:19:31.496930 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496906    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496934    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496945    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768cfdff76-wxc2q: secret "image-registry-tls" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496936    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert podName:9f1110bc-3087-4f49-9e1c-5371b8c85d09 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.496926113 +0000 UTC m=+33.079684174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-kjxhd" (UID: "9f1110bc-3087-4f49-9e1c-5371b8c85d09") : secret "networking-console-plugin-cert" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496980    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls podName:4b6aeef2-7878-466d-964c-2a375bdb8f04 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.496970663 +0000 UTC m=+33.079728712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls") pod "image-registry-768cfdff76-wxc2q" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04") : secret "image-registry-tls" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.496985    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.497015    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.497005032 +0000 UTC m=+33.079763096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : secret "router-metrics-certs-default" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.497030    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.497038    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869764d77-758qx: secret "image-registry-tls" not found
Oct 30 16:19:31.497166 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:31.497066    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls podName:afdf3517-540a-470f-b111-043df8f007c5 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:33.497056984 +0000 UTC m=+33.079815046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls") pod "image-registry-7869764d77-758qx" (UID: "afdf3517-540a-470f-b111-043df8f007c5") : secret "image-registry-tls" not found
Oct 30 16:19:33.300562 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.300454    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng" event={"ID":"52e59496-41f2-430d-8c96-467b3ef3a839","Type":"ContainerStarted","Data":"9fcbd9222bb4d69d26524c977e5745eff03ad5eaa9ac1f43bc32120028087242"}
Oct 30 16:19:33.342614 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.342502    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng" podStartSLOduration=151.590327126 podStartE2EDuration="2m33.342481275s" totalImagesPullingTime="1.752154149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:33.341739584 +0000 UTC m=+32.924497654" watchObservedRunningTime="2026-10-30 16:19:33.342481275 +0000 UTC m=+32.925239342"
Oct 30 16:19:33.484845 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.484779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:33.519385 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.519332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:33.519553 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.519400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:33.519553 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.519431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:33.519553 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.519462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:33.519553 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.519509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:33.519553 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.519539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:33.519850 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.519579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:33.519850 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.519662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:33.519850 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.519808    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:33.519988 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.519867    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.519849382 +0000 UTC m=+37.102607432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:33.520285 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520268    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.520253858 +0000 UTC m=+37.103011907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:33.520403 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520362    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:33.520403 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520375    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768cfdff76-wxc2q: secret "image-registry-tls" not found
Oct 30 16:19:33.520505 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520411    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls podName:4b6aeef2-7878-466d-964c-2a375bdb8f04 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.52039865 +0000 UTC m=+37.103156699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls") pod "image-registry-768cfdff76-wxc2q" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04") : secret "image-registry-tls" not found
Oct 30 16:19:33.520505 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520472    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:33.520505 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520482    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869764d77-758qx: secret "image-registry-tls" not found
Oct 30 16:19:33.520648 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520583    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 16:19:33.520703 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520653    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:33.520750 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520719    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 16:19:33.520799 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520790    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 16:19:33.520980 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.520964    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls podName:afdf3517-540a-470f-b111-043df8f007c5 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.52049995 +0000 UTC m=+37.103258001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls") pod "image-registry-7869764d77-758qx" (UID: "afdf3517-540a-470f-b111-043df8f007c5") : secret "image-registry-tls" not found
Oct 30 16:19:33.521063 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.521005    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.520982919 +0000 UTC m=+37.103740999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : secret "router-metrics-certs-default" not found
Oct 30 16:19:33.521063 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.521022    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls podName:41c538db-7de5-4e4d-ba29-d329164990cd nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.521012573 +0000 UTC m=+37.103770661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5knxh" (UID: "41c538db-7de5-4e4d-ba29-d329164990cd") : secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:33.521063 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.521037    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert podName:9f1110bc-3087-4f49-9e1c-5371b8c85d09 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.52102859 +0000 UTC m=+37.103786644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-kjxhd" (UID: "9f1110bc-3087-4f49-9e1c-5371b8c85d09") : secret "networking-console-plugin-cert" not found
Oct 30 16:19:33.521063 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.521050    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls podName:30f743ff-35c0-42c8-9ab1-422606471aa0 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.521042206 +0000 UTC m=+37.103800261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls") pod "dns-default-l8nf9" (UID: "30f743ff-35c0-42c8-9ab1-422606471aa0") : secret "dns-default-metrics-tls" not found
Oct 30 16:19:33.636564 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.636446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:33.721745 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.721709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:33.722002 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.721810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:33.722002 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.721944    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 16:19:33.722122 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:33.722017    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs podName:88847d7c-8749-4920-9c90-97f93bbfc432 nodeName:}" failed. No retries permitted until 2026-10-30 16:20:05.721995115 +0000 UTC m=+65.304753177 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs") pod "network-metrics-daemon-rttw4" (UID: "88847d7c-8749-4920-9c90-97f93bbfc432") : secret "metrics-daemon-secret" not found
Oct 30 16:19:33.728964 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.728942    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:33.823489 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.823450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:33.834154 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.834111    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:33.841926 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.841902    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:33.847363 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:33.847327    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:34.173446 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:34.173409    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7c4px"]
Oct 30 16:19:34.205886 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:34.205855    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4xnzd"]
Oct 30 16:19:34.232448 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:34.232415    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5d808e_a4ea_455f_9ea9_6e0a2f14ec36.slice/crio-c25eb76abe89bcfa3582e7e1b6776591795b0a0dee3116798ecba2fa6b294d66 WatchSource:0}: Error finding container c25eb76abe89bcfa3582e7e1b6776591795b0a0dee3116798ecba2fa6b294d66: Status 404 returned error can't find the container with id c25eb76abe89bcfa3582e7e1b6776591795b0a0dee3116798ecba2fa6b294d66
Oct 30 16:19:34.233506 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:34.233479    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc642127_45e3_46e5_897f_93b899a68127.slice/crio-5fc302ebcd39fbe4c3f04b33e4231b8f239b3300a15366fc2796ad87cbb8b71e WatchSource:0}: Error finding container 5fc302ebcd39fbe4c3f04b33e4231b8f239b3300a15366fc2796ad87cbb8b71e: Status 404 returned error can't find the container with id 5fc302ebcd39fbe4c3f04b33e4231b8f239b3300a15366fc2796ad87cbb8b71e
Oct 30 16:19:34.307278 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:34.307227    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4xnzd" event={"ID":"fc642127-45e3-46e5-897f-93b899a68127","Type":"ContainerStarted","Data":"5fc302ebcd39fbe4c3f04b33e4231b8f239b3300a15366fc2796ad87cbb8b71e"}
Oct 30 16:19:34.309847 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:34.309776    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7c4px" event={"ID":"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36","Type":"ContainerStarted","Data":"c25eb76abe89bcfa3582e7e1b6776591795b0a0dee3116798ecba2fa6b294d66"}
Oct 30 16:19:35.315635 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:35.315459    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/0.log"
Oct 30 16:19:35.315635 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:35.315503    2583 generic.go:356] "Generic (PLEG): container finished" podID="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa" containerID="3db306672330c8864aad3ad32378ef7aa9d3c1ebffa00f5732f52e7fdbedf591" exitCode=255
Oct 30 16:19:35.315635 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:35.315578    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4" event={"ID":"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa","Type":"ContainerDied","Data":"3db306672330c8864aad3ad32378ef7aa9d3c1ebffa00f5732f52e7fdbedf591"}
Oct 30 16:19:35.316214 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:35.315891    2583 scope.go:122] "RemoveContainer" containerID="3db306672330c8864aad3ad32378ef7aa9d3c1ebffa00f5732f52e7fdbedf591"
Oct 30 16:19:36.324241 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.324123    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw" event={"ID":"3dd6c0df-eb3d-4433-839e-abdf00f47695","Type":"ContainerStarted","Data":"145f310b3beff9a211411e9a8036485dbd583ab0118159042b07acedb9637826"}
Oct 30 16:19:36.327698 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.327139    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8" event={"ID":"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea","Type":"ContainerStarted","Data":"bd1da19b87e65f8a6ca732bacbb530cf3c183c8a78800acad0725347d6a9b3cd"}
Oct 30 16:19:36.333869 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.333842    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbczx" event={"ID":"64de0045-bcde-40a0-938e-d2eeee30f20c","Type":"ContainerStarted","Data":"d16ff3c25bbc1aa4d4650b9903edbbc63b2224bf582a64ad2d035c8ecf3d1305"}
Oct 30 16:19:36.338178 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.338096    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:19:36.339815 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.338804    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/0.log"
Oct 30 16:19:36.339815 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.338838    2583 generic.go:356] "Generic (PLEG): container finished" podID="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa" containerID="1f13a1bbb1950524457cdc79dcdd92cef71cec9bdd41f7949640c3c77e41c508" exitCode=255
Oct 30 16:19:36.339815 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.338920    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4" event={"ID":"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa","Type":"ContainerDied","Data":"1f13a1bbb1950524457cdc79dcdd92cef71cec9bdd41f7949640c3c77e41c508"}
Oct 30 16:19:36.339815 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.338962    2583 scope.go:122] "RemoveContainer" containerID="3db306672330c8864aad3ad32378ef7aa9d3c1ebffa00f5732f52e7fdbedf591"
Oct 30 16:19:36.339815 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.339327    2583 scope.go:122] "RemoveContainer" containerID="1f13a1bbb1950524457cdc79dcdd92cef71cec9bdd41f7949640c3c77e41c508"
Oct 30 16:19:36.339815 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:36.339544    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-ml6q4_openshift-console-operator(d5b9aacd-cd48-4496-a43a-ce89ff7a29fa)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4" podUID="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa"
Oct 30 16:19:36.346067 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.346043    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-zfp2k" event={"ID":"d28bb413-77af-4b21-9ee8-489c521b4603","Type":"ContainerStarted","Data":"d1b5614baa867b7b12f485ebf7cef0acc24986cff21aee48ec2cc1075cf5af96"}
Oct 30 16:19:36.369667 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.369613    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw" podStartSLOduration=148.377626025 podStartE2EDuration="2m33.369593435s" totalImagesPullingTime="4.99196741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:36.368952804 +0000 UTC m=+35.951710876" watchObservedRunningTime="2026-10-30 16:19:36.369593435 +0000 UTC m=+35.952351508"
Oct 30 16:19:36.394799 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.394769    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wkcqh"]
Oct 30 16:19:36.434848 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.434775    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wkcqh"]
Oct 30 16:19:36.435022 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.434870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.458996 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.458963    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 16:19:36.459144 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.459010    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 16:19:36.459144 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.459118    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-snnbg\""
Oct 30 16:19:36.461694 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.461667    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-b82vr-4mwk6"]
Oct 30 16:19:36.481331 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.481291    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.483810 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.483764    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-zfp2k" podStartSLOduration=152.426163954 podStartE2EDuration="2m37.483749552s" totalImagesPullingTime="5.057585598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:36.469051929 +0000 UTC m=+36.051809999" watchObservedRunningTime="2026-10-30 16:19:36.483749552 +0000 UTC m=+36.066507664"
Oct 30 16:19:36.485105 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.485079    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-b82vr-4mwk6"]
Oct 30 16:19:36.514191 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.514133    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rbczx" podStartSLOduration=2.099241797 podStartE2EDuration="7.514115209s" totalImagesPullingTime="5.414873412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:36.512674929 +0000 UTC m=+36.095432996" watchObservedRunningTime="2026-10-30 16:19:36.514115209 +0000 UTC m=+36.096873269"
Oct 30 16:19:36.517704 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.517672    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:36.549887 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.549856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8hr4\" (UniqueName: \"kubernetes.io/projected/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-api-access-d8hr4\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.550045 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.549983    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-data-volume\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.550105 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.550052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.550105 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.550099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.550176 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.550168    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.550213 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.550191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzqv8\" (UniqueName: \"kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.550243 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.550216    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-crio-socket\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.550332 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.550316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.550718 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.550694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.598563 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.597182    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8" podStartSLOduration=146.475999308 podStartE2EDuration="2m31.597163803s" totalImagesPullingTime="5.121164495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:36.556430354 +0000 UTC m=+36.139188424" watchObservedRunningTime="2026-10-30 16:19:36.597163803 +0000 UTC m=+36.179921873"
Oct 30 16:19:36.651568 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.651526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.651568 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.651569    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzqv8\" (UniqueName: \"kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.651813 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.651590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-crio-socket\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.651813 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.651671    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-crio-socket\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.651813 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.651793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.651962 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.651879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.651962 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:36.651908    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:36.651962 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.651918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8hr4\" (UniqueName: \"kubernetes.io/projected/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-api-access-d8hr4\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.652102 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.651966    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.652102 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:36.651988    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.151966414 +0000 UTC m=+36.734724477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:36.652102 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:36.652004    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:36.652102 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.652023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-data-volume\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.652102 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.652050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.652102 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:36.652061    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:37.152047852 +0000 UTC m=+36.734805916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:36.652102 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.652095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.652492 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.652464    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-data-volume\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.652617 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.652560    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.652905 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.652887    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.662205 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.662174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:36.678856 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.678694    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8hr4\" (UniqueName: \"kubernetes.io/projected/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-api-access-d8hr4\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:36.678856 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.678778    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzqv8\" (UniqueName: \"kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.802330 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.802295    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"]
Oct 30 16:19:36.819701 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.819667    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"]
Oct 30 16:19:36.819858 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.819735    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:36.819987 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.819964    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"
Oct 30 16:19:36.835020 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.834974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:36.836092 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.836067    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"]
Oct 30 16:19:36.836228 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.836107    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"]
Oct 30 16:19:36.836228 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.836191    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"
Oct 30 16:19:36.836607 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.836565    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:36.836607 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.836601    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 16:19:36.836798 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.836618    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qnjml\""
Oct 30 16:19:36.955624 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.955592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw6dq\" (UniqueName: \"kubernetes.io/projected/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690-kube-api-access-sw6dq\") pod \"migrator-66df5d496b-xf9mk\" (UID: \"2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"
Oct 30 16:19:36.955854 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.955827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v9bm\" (UniqueName: \"kubernetes.io/projected/22bd7f2a-ce4d-4888-a8bb-521657c81151-kube-api-access-7v9bm\") pod \"migrator-66df5d496b-txhn7\" (UID: \"22bd7f2a-ce4d-4888-a8bb-521657c81151\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"
Oct 30 16:19:36.987861 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:36.987826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:37.056901 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.056394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9bm\" (UniqueName: \"kubernetes.io/projected/22bd7f2a-ce4d-4888-a8bb-521657c81151-kube-api-access-7v9bm\") pod \"migrator-66df5d496b-txhn7\" (UID: \"22bd7f2a-ce4d-4888-a8bb-521657c81151\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"
Oct 30 16:19:37.056901 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.056474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6dq\" (UniqueName: \"kubernetes.io/projected/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690-kube-api-access-sw6dq\") pod \"migrator-66df5d496b-xf9mk\" (UID: \"2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"
Oct 30 16:19:37.080190 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.080113    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9bm\" (UniqueName: \"kubernetes.io/projected/22bd7f2a-ce4d-4888-a8bb-521657c81151-kube-api-access-7v9bm\") pod \"migrator-66df5d496b-txhn7\" (UID: \"22bd7f2a-ce4d-4888-a8bb-521657c81151\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"
Oct 30 16:19:37.082045 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.081969    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6dq\" (UniqueName: \"kubernetes.io/projected/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690-kube-api-access-sw6dq\") pod \"migrator-66df5d496b-xf9mk\" (UID: \"2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"
Oct 30 16:19:37.140108 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.140075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:37.142021 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.141995    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"
Oct 30 16:19:37.157188 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.157165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:37.157306 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.157297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:37.157414 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.157390    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:37.157540 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.157453    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:38.157435979 +0000 UTC m=+37.740194031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:37.157816 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.157800    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:37.157901 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.157841    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:38.157830263 +0000 UTC m=+37.740588310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:37.169549 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.169381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"
Oct 30 16:19:37.286653 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.286618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:37.295651 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.295590    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-b82vr-4mwk6"]
Oct 30 16:19:37.297959 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:37.297930    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548f7cd0_4adf_403f_b879_fb8be191d374.slice/crio-5e73996eb8296158509bed53e8ecf389b5475dbe41a9fe4026dbcf52f5d89872 WatchSource:0}: Error finding container 5e73996eb8296158509bed53e8ecf389b5475dbe41a9fe4026dbcf52f5d89872: Status 404 returned error can't find the container with id 5e73996eb8296158509bed53e8ecf389b5475dbe41a9fe4026dbcf52f5d89872
Oct 30 16:19:37.351996 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.351953    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88" event={"ID":"a64c6e47-3cf0-4453-b3e6-2657a66813e8","Type":"ContainerStarted","Data":"4032743128afa263b3cf22bc1bc5e7495a9dee196e30bcddf7256ff4b55d38a2"}
Oct 30 16:19:37.353476 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.353445    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-b82vr-4mwk6" event={"ID":"548f7cd0-4adf-403f-b879-fb8be191d374","Type":"ContainerStarted","Data":"5e73996eb8296158509bed53e8ecf389b5475dbe41a9fe4026dbcf52f5d89872"}
Oct 30 16:19:37.355449 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.355428    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:19:37.356397 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.356239    2583 scope.go:122] "RemoveContainer" containerID="1f13a1bbb1950524457cdc79dcdd92cef71cec9bdd41f7949640c3c77e41c508"
Oct 30 16:19:37.356650 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.356614    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-ml6q4_openshift-console-operator(d5b9aacd-cd48-4496-a43a-ce89ff7a29fa)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4" podUID="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa"
Oct 30 16:19:37.400009 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.397351    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88" podStartSLOduration=142.962243798 podStartE2EDuration="2m29.397319413s" totalImagesPullingTime="6.435075615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:37.396594088 +0000 UTC m=+36.979352157" watchObservedRunningTime="2026-10-30 16:19:37.397319413 +0000 UTC m=+36.980077484"
Oct 30 16:19:37.445289 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.445252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:37.478904 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.468915    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"]
Oct 30 16:19:37.478904 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:37.469769    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0297c4_9de9_4bba_b1f4_eaf3ff2e8690.slice/crio-a588c649891157755aaa0f9438940cfa38c1b2966f674ef0a0f591898e3f731e WatchSource:0}: Error finding container a588c649891157755aaa0f9438940cfa38c1b2966f674ef0a0f591898e3f731e: Status 404 returned error can't find the container with id a588c649891157755aaa0f9438940cfa38c1b2966f674ef0a0f591898e3f731e
Oct 30 16:19:37.497426 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.497390    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"]
Oct 30 16:19:37.500607 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:37.500578    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bd7f2a_ce4d_4888_a8bb_521657c81151.slice/crio-d596ea12afbbf2cb5d36622f7eab65621f19977456e668158fb66217b34dd2a4 WatchSource:0}: Error finding container d596ea12afbbf2cb5d36622f7eab65621f19977456e668158fb66217b34dd2a4: Status 404 returned error can't find the container with id d596ea12afbbf2cb5d36622f7eab65621f19977456e668158fb66217b34dd2a4
Oct 30 16:19:37.561377 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.561098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:37.561377 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.561185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:37.561377 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.561219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:37.561377 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.561249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:37.561377 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561252    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:37.561377 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.561281    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:37.561377 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.561310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:37.561377 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561327    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.561306463 +0000 UTC m=+45.144064522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.561395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.561431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561440    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561498    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert podName:9f1110bc-3087-4f49-9e1c-5371b8c85d09 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.561490012 +0000 UTC m=+45.144248059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-kjxhd" (UID: "9f1110bc-3087-4f49-9e1c-5371b8c85d09") : secret "networking-console-plugin-cert" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561540    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.561526259 +0000 UTC m=+45.144284311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561547    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561569    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.561563396 +0000 UTC m=+45.144321501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : secret "router-metrics-certs-default" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561604    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561611    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561625    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768cfdff76-wxc2q: secret "image-registry-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561627    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls podName:30f743ff-35c0-42c8-9ab1-422606471aa0 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.561619049 +0000 UTC m=+45.144377132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls") pod "dns-default-l8nf9" (UID: "30f743ff-35c0-42c8-9ab1-422606471aa0") : secret "dns-default-metrics-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561675    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561706    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls podName:4b6aeef2-7878-466d-964c-2a375bdb8f04 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.561661044 +0000 UTC m=+45.144419100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls") pod "image-registry-768cfdff76-wxc2q" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04") : secret "image-registry-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561727    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561734    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869764d77-758qx: secret "image-registry-tls" not found
Oct 30 16:19:37.561865 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561752    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls podName:afdf3517-540a-470f-b111-043df8f007c5 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.561746819 +0000 UTC m=+45.144504906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls") pod "image-registry-7869764d77-758qx" (UID: "afdf3517-540a-470f-b111-043df8f007c5") : secret "image-registry-tls" not found
Oct 30 16:19:37.562502 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:37.561762    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls podName:41c538db-7de5-4e4d-ba29-d329164990cd nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.561757436 +0000 UTC m=+45.144515482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5knxh" (UID: "41c538db-7de5-4e4d-ba29-d329164990cd") : secret "cluster-monitoring-operator-tls" not found
Oct 30 16:19:37.569787 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.569759    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-nvmr7"]
Oct 30 16:19:37.590896 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.590865    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.600748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.600717    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-nvmr7"]
Oct 30 16:19:37.606422 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.606392    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 16:19:37.606560 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.606522    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 16:19:37.606674 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.606660    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jr7g9\""
Oct 30 16:19:37.606748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.606703    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 16:19:37.606748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.606746    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 16:19:37.662621 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.662579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-key\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.662822 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.662796    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-cabundle\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.662933 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.662920    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf99n\" (UniqueName: \"kubernetes.io/projected/ee06d536-e9ad-4690-87e1-3a82db673caa-kube-api-access-zf99n\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.763894 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.763813    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-cabundle\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.764064 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.763926    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf99n\" (UniqueName: \"kubernetes.io/projected/ee06d536-e9ad-4690-87e1-3a82db673caa-kube-api-access-zf99n\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.764064 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.763998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-key\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.764811 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.764783    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-cabundle\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.766911 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.766889    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-key\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.788431 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.788334    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf99n\" (UniqueName: \"kubernetes.io/projected/ee06d536-e9ad-4690-87e1-3a82db673caa-kube-api-access-zf99n\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:37.911745 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.911702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:37.915870 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:37.915842    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:38.062735 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.062647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:38.169616 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.169579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:38.169807 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.169667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:38.169807 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:38.169737    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:38.169885 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:38.169811    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:40.169794098 +0000 UTC m=+39.752552164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:38.169885 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:38.169841    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:38.169976 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:38.169893    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:40.169876745 +0000 UTC m=+39.752634816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:38.235185 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.235155    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-nvmr7"]
Oct 30 16:19:38.236986 ip-10-0-138-40 kubenswrapper[2583]: W1030 16:19:38.236850    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee06d536_e9ad_4690_87e1_3a82db673caa.slice/crio-4329d3424d0d4ee8a9767df4c9e7312f6a2f114b061e3725c98aabbe9032db68 WatchSource:0}: Error finding container 4329d3424d0d4ee8a9767df4c9e7312f6a2f114b061e3725c98aabbe9032db68: Status 404 returned error can't find the container with id 4329d3424d0d4ee8a9767df4c9e7312f6a2f114b061e3725c98aabbe9032db68
Oct 30 16:19:38.361036 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.360966    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7c4px" event={"ID":"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36","Type":"ContainerStarted","Data":"b91070d5488d5506139778a60d09fbe59efdf5c4864ea06cd0b02cfc1858ff5e"}
Oct 30 16:19:38.361664 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.361647    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:38.364923 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.364898    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-b82vr-4mwk6" event={"ID":"548f7cd0-4adf-403f-b879-fb8be191d374","Type":"ContainerStarted","Data":"e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0"}
Oct 30 16:19:38.367335 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.367307    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7" event={"ID":"22bd7f2a-ce4d-4888-a8bb-521657c81151","Type":"ContainerStarted","Data":"d596ea12afbbf2cb5d36622f7eab65621f19977456e668158fb66217b34dd2a4"}
Oct 30 16:19:38.373748 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.373715    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk" event={"ID":"2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690","Type":"ContainerStarted","Data":"a588c649891157755aaa0f9438940cfa38c1b2966f674ef0a0f591898e3f731e"}
Oct 30 16:19:38.377149 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.376450    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7" event={"ID":"ee06d536-e9ad-4690-87e1-3a82db673caa","Type":"ContainerStarted","Data":"882b92418308f316d995d75607d2e011355c628dc3e5932337510f117dafa6c8"}
Oct 30 16:19:38.377149 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.376485    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7" event={"ID":"ee06d536-e9ad-4690-87e1-3a82db673caa","Type":"ContainerStarted","Data":"4329d3424d0d4ee8a9767df4c9e7312f6a2f114b061e3725c98aabbe9032db68"}
Oct 30 16:19:38.402516 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.402447    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7c4px" podStartSLOduration=34.25387678 podStartE2EDuration="37.402429786s" totalImagesPullingTime="3.148553006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:38.401856179 +0000 UTC m=+37.984614248" watchObservedRunningTime="2026-10-30 16:19:38.402429786 +0000 UTC m=+37.985187858"
Oct 30 16:19:38.444210 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.444152    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-b82vr-4mwk6" podStartSLOduration=2.444138035 podStartE2EDuration="2.444138035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:38.442884023 +0000 UTC m=+38.025642092" watchObservedRunningTime="2026-10-30 16:19:38.444138035 +0000 UTC m=+38.026896103"
Oct 30 16:19:38.485686 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.485622    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7" podStartSLOduration=1.485603653 podStartE2EDuration="1.485603653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:38.485489576 +0000 UTC m=+38.068247640" watchObservedRunningTime="2026-10-30 16:19:38.485603653 +0000 UTC m=+38.068361728"
Oct 30 16:19:38.538040 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.538004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:38.695625 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:38.695587    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:39.385228 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:39.385193    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7" event={"ID":"22bd7f2a-ce4d-4888-a8bb-521657c81151","Type":"ContainerStarted","Data":"1197706505e4178b8f5beb39b8663408cfa1c176b6b61319b7e13d66523e4910"}
Oct 30 16:19:39.388152 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:39.388124    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk" event={"ID":"2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690","Type":"ContainerStarted","Data":"611e6f56d732a485e528524cf44be4fd3a1b4f725afd4cdf311f4a4adcc1147a"}
Oct 30 16:19:39.425712 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:39.425659    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7" podStartSLOduration=1.681088086 podStartE2EDuration="3.425644529s" totalImagesPullingTime="1.744556443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:39.425216433 +0000 UTC m=+39.007974503" watchObservedRunningTime="2026-10-30 16:19:39.425644529 +0000 UTC m=+39.008402595"
Oct 30 16:19:39.466034 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:39.465975    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk" podStartSLOduration=1.6936441740000001 podStartE2EDuration="3.465955268s" totalImagesPullingTime="1.772311094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:39.464859136 +0000 UTC m=+39.047617216" watchObservedRunningTime="2026-10-30 16:19:39.465955268 +0000 UTC m=+39.048713340"
Oct 30 16:19:39.850829 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:39.850784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:39.926071 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:39.925982    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4b9s_37d06c87-6ddd-4605-9322-9e13e26eaaa4/dns-node-resolver/0.log"
Oct 30 16:19:40.014461 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.014394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:40.111152 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.110934    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:40.111152 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.111035    2583 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:40.111502 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.111480    2583 scope.go:122] "RemoveContainer" containerID="1f13a1bbb1950524457cdc79dcdd92cef71cec9bdd41f7949640c3c77e41c508"
Oct 30 16:19:40.111726 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:40.111700    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-ml6q4_openshift-console-operator(d5b9aacd-cd48-4496-a43a-ce89ff7a29fa)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4" podUID="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa"
Oct 30 16:19:40.167560 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.167529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:40.202667 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.202633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:40.202811 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.202699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:40.202811 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:40.202761    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:40.202905 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:40.202842    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:44.202823986 +0000 UTC m=+43.785582050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:40.202905 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:40.202872    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:40.203008 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:40.202944    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:44.202925329 +0000 UTC m=+43.785683399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:40.391058 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.391032    2583 scope.go:122] "RemoveContainer" containerID="1f13a1bbb1950524457cdc79dcdd92cef71cec9bdd41f7949640c3c77e41c508"
Oct 30 16:19:40.391428 ip-10-0-138-40 kubenswrapper[2583]: E1030 16:19:40.391184    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-ml6q4_openshift-console-operator(d5b9aacd-cd48-4496-a43a-ce89ff7a29fa)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4" podUID="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa"
Oct 30 16:19:40.717763 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.717730    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:40.866423 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.866392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:40.875354 ip-10-0-138-40 kubenswrapper[2583]: I1030 16:19:40.875234    2583 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:19:40.875404 ip-10-0-138-40 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 16:19:40.892811 ip-10-0-138-40 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 16:19:40.892988 ip-10-0-138-40 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 16:19:40.893042 ip-10-0-138-40 systemd[1]: kubelet.service: Consumed 3.191s CPU time.
Oct 30 16:19:40.902950 ip-10-0-138-40 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 16:19:40.987820 ip-10-0-138-40 kubenswrapper[5101]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:40.987820 ip-10-0-138-40 kubenswrapper[5101]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 16:19:40.987820 ip-10-0-138-40 kubenswrapper[5101]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:40.987820 ip-10-0-138-40 kubenswrapper[5101]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:40.989987 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.989898    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:40.989987 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.989987    5101 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.989992    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.989995    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.989998    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990001    5101 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990004    5101 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990008    5101 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990011    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990019    5101 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990022    5101 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990025    5101 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990028    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990030    5101 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990033    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990037    5101 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990042    5101 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990046    5101 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990049    5101 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990053    5101 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:40.990048 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990058    5101 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990062    5101 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990066    5101 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990069    5101 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990071    5101 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990074    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990077    5101 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990079    5101 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990082    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990085    5101 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990087    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990090    5101 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990093    5101 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990095    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990097    5101 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990100    5101 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990102    5101 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990105    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990107    5101 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990111    5101 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:40.990525 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990114    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990117    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990120    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990122    5101 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990125    5101 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990128    5101 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990130    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990133    5101 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990137    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990139    5101 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990142    5101 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990145    5101 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990147    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990150    5101 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990154    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990156    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990159    5101 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990162    5101 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990165    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:40.991035 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990167    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990170    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990173    5101 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990176    5101 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990178    5101 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990181    5101 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990183    5101 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990186    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990188    5101 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990191    5101 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990194    5101 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990197    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990199    5101 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990203    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990205    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990208    5101 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990211    5101 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990213    5101 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990216    5101 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:40.991526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990219    5101 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990221    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990224    5101 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990226    5101 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990229    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990232    5101 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990235    5101 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990238    5101 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990241    5101 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990243    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990246    5101 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990249    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990251    5101 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990254    5101 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990256    5101 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990259    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990262    5101 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990264    5101 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990267    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990269    5101 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:40.992034 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990272    5101 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990275    5101 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990278    5101 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990280    5101 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990283    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990287    5101 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990290    5101 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.990293    5101 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991088    5101 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991096    5101 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991099    5101 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991101    5101 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991104    5101 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991107    5101 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991110    5101 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991112    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991115    5101 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991118    5101 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991120    5101 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:40.992526 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991123    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991126    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991129    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991131    5101 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991134    5101 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991138    5101 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991142    5101 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991145    5101 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991148    5101 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991152    5101 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991155    5101 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991158    5101 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991160    5101 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991163    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991166    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991168    5101 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991171    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991174    5101 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991176    5101 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:40.992996 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991179    5101 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991182    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991185    5101 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991188    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991191    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991194    5101 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991196    5101 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991198    5101 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991201    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991204    5101 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991207    5101 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991209    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991212    5101 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991215    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991217    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991220    5101 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991222    5101 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991225    5101 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991236    5101 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991239    5101 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:40.993515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991242    5101 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991245    5101 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991248    5101 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991251    5101 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991253    5101 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991256    5101 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991258    5101 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991261    5101 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991264    5101 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991266    5101 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991270    5101 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991273    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991275    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991278    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991281    5101 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991287    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991290    5101 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991293    5101 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991296    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991298    5101 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:40.993988 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991301    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991304    5101 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991306    5101 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991309    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991312    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991315    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991317    5101 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991320    5101 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991323    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991326    5101 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991328    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991331    5101 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991333    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991350    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991355    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991358    5101 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991360    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991363    5101 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991366    5101 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:40.994567 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991369    5101 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991372    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991376    5101 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991379    5101 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991382    5101 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991388    5101 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991391    5101 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991394    5101 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991397    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991400    5101 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991403    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991406    5101 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991409    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991411    5101 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991419    5101 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991422    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991424    5101 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991905    5101 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991911    5101 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991914    5101 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:40.995134 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991917    5101 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991921    5101 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991924    5101 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991927    5101 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991929    5101 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991932    5101 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991935    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991938    5101 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991940    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991945    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991948    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991950    5101 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991953    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991955    5101 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991958    5101 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991961    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991963    5101 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991966    5101 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991969    5101 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991971    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:40.995660 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991974    5101 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991977    5101 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991980    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991982    5101 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991985    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991988    5101 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991991    5101 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991993    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991996    5101 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.991998    5101 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992001    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992003    5101 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992006    5101 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992008    5101 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992011    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992013    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992016    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992018    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992021    5101 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:40.996240 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992024    5101 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992026    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992030    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992034    5101 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992038    5101 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992041    5101 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992043    5101 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992046    5101 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992049    5101 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992051    5101 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992054    5101 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992056    5101 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992059    5101 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992061    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992064    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992067    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992070    5101 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992073    5101 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992075    5101 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:40.997017 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992078    5101 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992081    5101 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992083    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992086    5101 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992088    5101 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992091    5101 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992094    5101 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992096    5101 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992100    5101 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992104    5101 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992107    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992110    5101 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992113    5101 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992115    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992118    5101 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992122    5101 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992124    5101 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992127    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992129    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:40.997624 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992132    5101 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992134    5101 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992137    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992140    5101 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992143    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992145    5101 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992148    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992150    5101 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992153    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992156    5101 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992160    5101 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992162    5101 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992165    5101 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992168    5101 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992170    5101 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992173    5101 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992175    5101 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992178    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992181    5101 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992183    5101 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:40.998088 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992185    5101 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992188    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992191    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992193    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992197    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992199    5101 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992293    5101 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992308    5101 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992317    5101 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992322    5101 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992326    5101 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992329    5101 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992334    5101 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992360    5101 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992364    5101 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992367    5101 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992371    5101 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992374    5101 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992377    5101 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992380    5101 flags.go:64] FLAG: --cgroup-root=""
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992383    5101 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992386    5101 flags.go:64] FLAG: --client-ca-file=""
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992389    5101 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 16:19:40.998595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992393    5101 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992397    5101 flags.go:64] FLAG: --cluster-domain=""
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992400    5101 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992403    5101 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992406    5101 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992410    5101 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992414    5101 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992417    5101 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992421    5101 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992424    5101 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992427    5101 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992432    5101 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992435    5101 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992438    5101 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992441    5101 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992446    5101 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992449    5101 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992454    5101 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992457    5101 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992460    5101 flags.go:64] FLAG: --enable-server="true"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992463    5101 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992467    5101 flags.go:64] FLAG: --event-burst="100"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992470    5101 flags.go:64] FLAG: --event-qps="50"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992473    5101 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 16:19:40.999157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992477    5101 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992480    5101 flags.go:64] FLAG: --eviction-hard=""
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992484    5101 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992487    5101 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992490    5101 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992493    5101 flags.go:64] FLAG: --eviction-soft=""
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992496    5101 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992500    5101 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992503    5101 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992506    5101 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992509    5101 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992512    5101 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992515    5101 flags.go:64] FLAG: --feature-gates=""
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992520    5101 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992523    5101 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992526    5101 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992530    5101 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992533    5101 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992537    5101 flags.go:64] FLAG: --help="false"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992542    5101 flags.go:64] FLAG: --hostname-override="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992545    5101 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992548    5101 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992551    5101 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992555    5101 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 16:19:40.999799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992558    5101 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992562    5101 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992565    5101 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992568    5101 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992572    5101 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992575    5101 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992578    5101 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992581    5101 flags.go:64] FLAG: --kube-reserved=""
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992584    5101 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992587    5101 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992590    5101 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992593    5101 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992596    5101 flags.go:64] FLAG: --lock-file=""
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992600    5101 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992603    5101 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992606    5101 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992612    5101 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992615    5101 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992619    5101 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992622    5101 flags.go:64] FLAG: --logging-format="text"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992626    5101 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992629    5101 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992632    5101 flags.go:64] FLAG: --manifest-url=""
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992635    5101 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992640    5101 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 16:19:41.000392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992643    5101 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992647    5101 flags.go:64] FLAG: --max-pods="110"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992651    5101 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992655    5101 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992658    5101 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992661    5101 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992664    5101 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992667    5101 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992670    5101 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992677    5101 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992681    5101 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992684    5101 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992687    5101 flags.go:64] FLAG: --pod-cidr=""
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992690    5101 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992693    5101 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992696    5101 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992699    5101 flags.go:64] FLAG: --port="10250"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992702    5101 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992705    5101 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05fa089b3ddbd6cfc"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992709    5101 flags.go:64] FLAG: --qos-reserved=""
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992712    5101 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992715    5101 flags.go:64] FLAG: --register-node="true"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992718    5101 flags.go:64] FLAG: --register-with-taints=""
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992722    5101 flags.go:64] FLAG: --registry-burst="10"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992725    5101 flags.go:64] FLAG: --registry-qps="5"
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992728    5101 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 16:19:41.000992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992731    5101 flags.go:64] FLAG: --reserved-memory=""
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992735    5101 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992738    5101 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992741    5101 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992744    5101 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992747    5101 flags.go:64] FLAG: --runonce="false"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992750    5101 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992753    5101 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992758    5101 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992761    5101 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992764    5101 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992767    5101 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992770    5101 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992773    5101 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992776    5101 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992780    5101 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992783    5101 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992786    5101 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992790    5101 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992793    5101 flags.go:64] FLAG: --system-cgroups=""
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992796    5101 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992801    5101 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992804    5101 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992807    5101 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992811    5101 flags.go:64] FLAG: --tls-min-version=""
Oct 30 16:19:41.001612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992814    5101 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992817    5101 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992820    5101 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992823    5101 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992826    5101 flags.go:64] FLAG: --v="2"
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992831    5101 flags.go:64] FLAG: --version="false"
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992835    5101 flags.go:64] FLAG: --vmodule=""
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992839    5101 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.992843    5101 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992985    5101 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992989    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992993    5101 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992996    5101 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.992999    5101 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993002    5101 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993007    5101 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993009    5101 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993012    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993015    5101 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993018    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993020    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:41.002207 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993023    5101 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993026    5101 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993028    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993031    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993034    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993036    5101 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993039    5101 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993042    5101 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993044    5101 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993047    5101 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993049    5101 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993052    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993055    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993057    5101 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993060    5101 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993063    5101 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993065    5101 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993068    5101 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993071    5101 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993073    5101 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:41.002789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993076    5101 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993079    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993082    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993085    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993088    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993090    5101 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993094    5101 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993097    5101 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993099    5101 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993103    5101 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993107    5101 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993112    5101 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993115    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993118    5101 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993121    5101 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993124    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993126    5101 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993129    5101 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993131    5101 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993134    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:41.003281 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993137    5101 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993139    5101 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993142    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993144    5101 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993147    5101 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993151    5101 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993154    5101 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993157    5101 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993160    5101 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993163    5101 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993165    5101 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993167    5101 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993170    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993173    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993176    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993178    5101 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993181    5101 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993183    5101 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993187    5101 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993190    5101 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:41.003808 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993193    5101 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993195    5101 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993198    5101 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993202    5101 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993205    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993208    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993210    5101 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993213    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993215    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993218    5101 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993220    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993223    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993226    5101 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993228    5101 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993231    5101 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993234    5101 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993236    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993239    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993241    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993244    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:41.004491 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993246    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993249    5101 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993251    5101 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993254    5101 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993256    5101 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993259    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993262    5101 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993265    5101 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993267    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993270    5101 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993274    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993277    5101 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993279    5101 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993282    5101 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.993307    5101 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993361    5101 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:41.005120 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993367    5101 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993370    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993374    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993377    5101 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993380    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993383    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993386    5101 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993389    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993391    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993394    5101 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993397    5101 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993399    5101 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993402    5101 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993405    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993407    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993410    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993412    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993415    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993417    5101 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993420    5101 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:41.005531 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993422    5101 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993425    5101 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993428    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993432    5101 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993434    5101 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993437    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993440    5101 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993444    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993447    5101 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993450    5101 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993453    5101 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993456    5101 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993459    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993462    5101 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993465    5101 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993467    5101 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993470    5101 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993472    5101 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993475    5101 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:41.006053 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993477    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993480    5101 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993483    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993485    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993488    5101 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993490    5101 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993493    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993495    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993498    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993501    5101 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993503    5101 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993506    5101 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993508    5101 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993511    5101 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993513    5101 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993516    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993519    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993523    5101 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993526    5101 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993528    5101 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:41.006792 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993532    5101 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993535    5101 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993538    5101 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993540    5101 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993544    5101 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993547    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993550    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993552    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993555    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993557    5101 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993560    5101 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993563    5101 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993566    5101 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993571    5101 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993575    5101 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993578    5101 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993580    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993583    5101 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993586    5101 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993589    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:41.007474 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993591    5101 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993594    5101 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993596    5101 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993599    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993601    5101 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993604    5101 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993606    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993609    5101 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993612    5101 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993615    5101 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993620    5101 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993623    5101 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993627    5101 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993630    5101 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993632    5101 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993635    5101 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993639    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993641    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993645    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:41.007955 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993648    5101 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993650    5101 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993653    5101 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993655    5101 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993658    5101 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993660    5101 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.993663    5101 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.998920    5101 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.998937    5101 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.998956    5101 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.998961    5101 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999021    5101 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999026    5101 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999029    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999033    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999036    5101 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999039    5101 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999042    5101 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999045    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999047    5101 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:41.008428 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999050    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999052    5101 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999055    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999058    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999061    5101 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999063    5101 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999066    5101 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999070    5101 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999073    5101 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999075    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999078    5101 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999081    5101 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999084    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999086    5101 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999089    5101 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999093    5101 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999097    5101 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999100    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999103    5101 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:41.008963 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999105    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999109    5101 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999111    5101 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999114    5101 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999116    5101 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999119    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999122    5101 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999124    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999127    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999129    5101 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999132    5101 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999135    5101 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999137    5101 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999140    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999143    5101 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999145    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999148    5101 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999151    5101 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999153    5101 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999156    5101 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:41.009456 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999159    5101 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999161    5101 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999164    5101 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999168    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999170    5101 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999173    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999177    5101 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999181    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999183    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999186    5101 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999189    5101 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999191    5101 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999194    5101 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999196    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999199    5101 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999202    5101 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999204    5101 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999207    5101 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999209    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:41.009938 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999212    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999214    5101 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999217    5101 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999220    5101 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999222    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999225    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999236    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999239    5101 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999242    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999244    5101 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999247    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999249    5101 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999253    5101 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999256    5101 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999259    5101 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999261    5101 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999264    5101 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999266    5101 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999269    5101 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:41.010542 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999271    5101 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999274    5101 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999276    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999279    5101 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999282    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999284    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999287    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999289    5101 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999292    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999295    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999298    5101 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999301    5101 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999303    5101 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999306    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999310    5101 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999312    5101 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999315    5101 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999318    5101 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999320    5101 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:41.011283 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999323    5101 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.999373    5101 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999521    5101 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999527    5101 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999531    5101 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999534    5101 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999536    5101 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999540    5101 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999543    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999546    5101 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999548    5101 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999552    5101 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999557    5101 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999561    5101 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999564    5101 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:41.012144 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999566    5101 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999569    5101 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999572    5101 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999574    5101 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999577    5101 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999580    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999582    5101 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999585    5101 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999587    5101 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999591    5101 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999593    5101 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999597    5101 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999599    5101 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999602    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999604    5101 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999607    5101 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999610    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999612    5101 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999615    5101 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999617    5101 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:41.012576 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999620    5101 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999623    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999625    5101 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999628    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999630    5101 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999633    5101 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999636    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999639    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999642    5101 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999644    5101 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999647    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999649    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999652    5101 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999654    5101 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999657    5101 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999659    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999661    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999665    5101 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999669    5101 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:41.013076 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999674    5101 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999678    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999682    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999686    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999690    5101 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999695    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999698    5101 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999701    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999704    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999706    5101 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999709    5101 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999712    5101 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999714    5101 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999717    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999720    5101 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999722    5101 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999725    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999728    5101 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999730    5101 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:41.013599 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999733    5101 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999736    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999739    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999742    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999744    5101 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999747    5101 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999749    5101 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999752    5101 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999754    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999757    5101 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999759    5101 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999762    5101 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999767    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999770    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999772    5101 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999775    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999777    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999780    5101 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999782    5101 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999785    5101 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:41.014330 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999787    5101 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999790    5101 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999793    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999795    5101 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999798    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999800    5101 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999803    5101 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999806    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999809    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999811    5101 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999814    5101 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999817    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999819    5101 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999823    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999826    5101 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:40.999852    5101 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:41.014837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999887    5101 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999892    5101 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999895    5101 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999898    5101 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999903    5101 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999906    5101 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999909    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999911    5101 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999915    5101 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999919    5101 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999924    5101 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999927    5101 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999930    5101 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999932    5101 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999935    5101 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999938    5101 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999941    5101 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999944    5101 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999947    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999949    5101 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:41.015293 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999952    5101 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999954    5101 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999957    5101 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999960    5101 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999962    5101 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999965    5101 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999967    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999970    5101 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999973    5101 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999975    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999979    5101 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999981    5101 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999984    5101 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999987    5101 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999989    5101 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999992    5101 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999995    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:40.999998    5101 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000001    5101 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000003    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:41.026891 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000007    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000010    5101 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000013    5101 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000015    5101 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000018    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000020    5101 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000023    5101 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000025    5101 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000028    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000030    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000033    5101 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000035    5101 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000039    5101 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000042    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000044    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000046    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000049    5101 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000052    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000054    5101 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:41.027719 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000057    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000059    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000062    5101 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000064    5101 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000067    5101 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000070    5101 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000073    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000075    5101 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000078    5101 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000082    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000084    5101 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000087    5101 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000090    5101 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000094    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000096    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000099    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000102    5101 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000105    5101 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000107    5101 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:41.028522 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000110    5101 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000112    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000115    5101 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000118    5101 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000120    5101 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000122    5101 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000125    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000127    5101 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000130    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000132    5101 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000135    5101 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000137    5101 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000140    5101 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000143    5101 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000145    5101 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000148    5101 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000150    5101 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000153    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000156    5101 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000159    5101 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:41.029275 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000162    5101 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000165    5101 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000169    5101 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000172    5101 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000175    5101 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000177    5101 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000181    5101 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:41.000184    5101 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.000249    5101 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.001254    5101 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.001313    5101 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.001508    5101 server.go:1014] "Starting client certificate rotation"
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.001649    5101 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.001696    5101 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 16:14:01 +0000 UTC" deadline="2028-07-22 10:00:14.24000879 +0000 UTC"
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.001741    5101 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15137h40m33.238269575s"
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.002012    5101 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:19:41.030122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.003108    5101 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:19:41.029329 ip-10-0-138-40 systemd[1]: Started Kubernetes Kubelet.
Oct 30 16:19:41.030876 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.004301    5101 log.go:25] "Validated CRI v1 runtime API"
Oct 30 16:19:41.030876 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.005993    5101 log.go:25] "Validated CRI v1 image API"
Oct 30 16:19:41.030876 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.006779    5101 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 16:19:41.030876 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.008904    5101 fs.go:135] Filesystem UUIDs: map[3291b41a-938f-4420-98be-fb4f746149b6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c8ffa649-78ba-46cc-ba72-c982ec8bc064:/dev/nvme0n1p3]
Oct 30 16:19:41.031062 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.008924    5101 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b26104cdf7e8270b1eaa4fb0491c726cac32f0eb3f50ebf4fd8501e14ad6a0c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b26104cdf7e8270b1eaa4fb0491c726cac32f0eb3f50ebf4fd8501e14ad6a0c/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0e3b7e2c04d7fda3dabd74c61789b3fba225f3f48479fa3dd7785dfc0024e46a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0e3b7e2c04d7fda3dabd74c61789b3fba225f3f48479fa3dd7785dfc0024e46a/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/162586301f0fea5cf3bda7b123888ed26870f412cabdf7bddfb130a2f5877e3e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/162586301f0fea5cf3bda7b123888ed26870f412cabdf7bddfb130a2f5877e3e/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/18405f154efaa4d5a42ba294e4847a893ecf2fb1a38bc5ce2333dac77487eada/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/18405f154efaa4d5a42ba294e4847a893ecf2fb1a38bc5ce2333dac77487eada/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1a9c91d9f6b201a2225c2b51bd9239b242acc35a9694e1300e8de9d2cfbfefa2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1a9c91d9f6b201a2225c2b51bd9239b242acc35a9694e1300e8de9d2cfbfefa2/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1a9dbaff1ffd908b9d83c5f87409074f2ad2e55f77beafcdf152705fbd41bf5f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1a9dbaff1ffd908b9d83c5f87409074f2ad2e55f77beafcdf152705fbd41bf5f/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3e2e4037dfb46a27d7321dea36a833499cca12bf1e293ea1da6e69969eb66010/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3e2e4037dfb46a27d7321dea36a833499cca12bf1e293ea1da6e69969eb66010/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3fb1fc6577a596f525550cdb6fe7e9d3b25c228ff303fdb46008002228c3b2be/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3fb1fc6577a596f525550cdb6fe7e9d3b25c228ff303fdb46008002228c3b2be/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4329d3424d0d4ee8a9767df4c9e7312f6a2f114b061e3725c98aabbe9032db68/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4329d3424d0d4ee8a9767df4c9e7312f6a2f114b061e3725c98aabbe9032db68/userdata/shm major:0 minor:362 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/538fc6c88ee927324db73ef308984085f2aa25139f0b20fec72315d7468bb5a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/538fc6c88ee927324db73ef308984085f2aa25139f0b20fec72315d7468bb5a9/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5bc3e51aef3ab8db5a6575b7dc2dce6a3264a9caf95154f05f21ae42b9e8e12d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5bc3e51aef3ab8db5a6575b7dc2dce6a3264a9caf95154f05f21ae42b9e8e12d/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5cb59c3405e961cf93da617bc6bb669f227669021f0e662ca734bd0f8a9ae19a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5cb59c3405e961cf93da617bc6bb669f227669021f0e662ca734bd0f8a9ae19a/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e73996eb8296158509bed53e8ecf389b5475dbe41a9fe4026dbcf52f5d89872/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e73996eb8296158509bed53e8ecf389b5475dbe41a9fe4026dbcf52f5d89872/userdata/shm major:0 minor:328 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5fc302ebcd39fbe4c3f04b33e4231b8f239b3300a15366fc2796ad87cbb8b71e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5fc302ebcd39fbe4c3f04b33e4231b8f239b3300a15366fc2796ad87cbb8b71e/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/60021494faea99c67a259ce5d5dfc419c7a1fa8ee0f0efd544436098df728a87/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/60021494faea99c67a259ce5d5dfc419c7a1fa8ee0f0efd544436098df728a87/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/72d0587f87aed62b45d0c825a89092a1f4a07253ae993565b5ccaad3893d8521/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/72d0587f87aed62b45d0c825a89092a1f4a07253ae993565b5ccaad3893d8521/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7da9c9e54c0ce6ce7ce4b284f481d1036b6b47ce24b1b23829cacf57f82951ee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7da9c9e54c0ce6ce7ce4b284f481d1036b6b47ce24b1b23829cacf57f82951ee/userdata/shm major:0 minor:49 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9283917c899282cf2576c5b0bb37d5a312004bfa485a043f0312080974ab45f6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9283917c899282cf2576c5b0bb37d5a312004bfa485a043f0312080974ab45f6/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9b8a91ff6a74ffe62dd6cd94ce4920bab0f5b928414b3e0e88e778e922e4d05d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9b8a91ff6a74ffe62dd6cd94ce4920bab0f5b928414b3e0e88e778e922e4d05d/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9fa913dabf362be3c185a12c28163cf454336c062705dd3388a9ab70be7c15f9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9fa913dabf362be3c185a12c28163cf454336c062705dd3388a9ab70be7c15f9/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a588c649891157755aaa0f9438940cfa38c1b2966f674ef0a0f591898e3f731e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a588c649891157755aaa0f9438940cfa38c1b2966f674ef0a0f591898e3f731e/userdata/shm major:0 minor:332 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c18912c0f94b715c3267103571a0e4bba6c0c6c2fef7a458c7446570a655080e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c18912c0f94b715c3267103571a0e4bba6c0c6c2fef7a458c7446570a655080e/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c25eb76abe89bcfa3582e7e1b6776591795b0a0dee3116798ecba2fa6b294d66/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c25eb76abe89bcfa3582e7e1b6776591795b0a0dee3116798ecba2fa6b294d66/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d596ea12afbbf2cb5d36622f7eab65621f19977456e668158fb66217b34dd2a4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d596ea12afbbf2cb5d36622f7eab65621f19977456e668158fb66217b34dd2a4/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d7a199c4b6899687dc5a371143f408b5a1a1f5f3d6ac5160a5677795c4ae860e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d7a199c4b6899687dc5a371143f408b5a1a1f5f3d6ac5160a5677795c4ae860e/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f807fa47632726c046e6f82b99def2a4d97328e96c65f3f242dcb2986b5b1830/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f807fa47632726c046e6f82b99def2a4d97328e96c65f3f242dcb2986b5b1830/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a402821-d2bd-4ebe-a4cb-897a5b3f4625/volumes/kubernetes.io~projected/kube-api-access-d8hr4:{mountpoint:/var/lib/kubelet/pods/0a402821-d2bd-4ebe-a4cb-897a5b3f4625/volumes/kubernetes.io~projected/kube-api-access-d8hr4 major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volumes/kubernetes.io~projected/kube-api-access-98tr6:{mountpoint:/var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volumes/kubernetes.io~projected/kube-api-access-98tr6 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/17bcd7b8-e377-451f-809b-9887d5b937e2/volumes/kubernetes.io~projected/kube-api-access-nq84b:{mountpoint:/var/lib/kubelet/pods/17bcd7b8-e377-451f-809b-9887d5b937e2/volumes/kubernetes.io~projected/kube-api-access-nq84b major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22bd7f2a-ce4d-4888-a8bb-521657c81151/volumes/kubernetes.io~projected/kube-api-access-7v9bm:{mountpoint:/var/lib/kubelet/pods/22bd7f2a-ce4d-4888-a8bb-521657c81151/volumes/kubernetes.io~projected/kube-api-access-7v9bm major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690/volumes/kubernetes.io~projected/kube-api-access-sw6dq:{mountpoint:/var/lib/kubelet/pods/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690/volumes/kubernetes.io~projected/kube-api-access-sw6dq major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30f743ff-35c0-42c8-9ab1-422606471aa0/volumes/kubernetes.io~projected/kube-api-access-lmhzz:{mountpoint:/var/lib/kubelet/pods/30f743ff-35c0-42c8-9ab1-422606471aa0/volumes/kubernetes.io~projected/kube-api-access-lmhzz major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/37d06c87-6ddd-4605-9322-9e13e26eaaa4/volumes/kubernetes.io~projected/kube-api-access-sqcch:{mountpoint:/var/lib/kubelet/pods/37d06c87-6ddd-4605-9322-9e13e26eaaa4/volumes/kubernetes.io~projected/kube-api-access-sqcch major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3dd6c0df-eb3d-4433-839e-abdf00f47695/volumes/kubernetes.io~projected/kube-api-access-7ssmb:{mountpoint:/var/lib/kubelet/pods/3dd6c0df-eb3d-4433-839e-abdf00f47695/volumes/kubernetes.io~projected/kube-api-access-7ssmb major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3dd6c0df-eb3d-4433-839e-abdf00f47695/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3dd6c0df-eb3d-4433-839e-abdf00f47695/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/41c538db-7de5-4e4d-ba29-d329164990cd/volumes/kubernetes.io~projected/kube-api-access-s2xq6:{mountpoint:/var/lib/kubelet/pods/41c538db-7de5-4e4d-ba29-d329164990cd/volumes/kubernetes.io~projected/kube-api-access-s2xq6 major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~projected/kube-api-access-5t5zt:{mountpoint:/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~projected/kube-api-access-5t5zt major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/52e59496-41f2-430d-8c96-467b3ef3a839/volumes/kubernetes.io~projected/kube-api-access-jn92z:{mountpoint:/var/lib/kubelet/pods/52e59496-41f2-430d-8c96-467b3ef3a839/volumes/kubernetes.io~projected/kube-api-access-jn92z major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/548f7cd0-4adf-403f-b879-fb8be191d374/volumes/kubernetes.io~projected/kube-api-access-vzqv8:{mountpoint:/var/lib/kubelet/pods/548f7cd0-4adf-403f-b879-fb8be191d374/volumes/kubernetes.io~projected/kube-api-access-vzqv8 major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5806cd90-2896-488a-ac38-10fc6d959026/volumes/kubernetes.io~projected/kube-api-access-zw7qz:{mountpoint:/var/lib/kubelet/pods/5806cd90-2896-488a-ac38-10fc6d959026/volumes/kubernetes.io~projected/kube-api-access-zw7qz major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5dcd8fb6-aaea-456a-bf39-c58f04323aee/volumes/kubernetes.io~projected/kube-api-access-rs9s4:{mountpoint:/var/lib/kubelet/pods/5dcd8fb6-aaea-456a-bf39-c58f04323aee/volumes/kubernetes.io~projected/kube-api-access-rs9s4 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64de0045-bcde-40a0-938e-d2eeee30f20c/volumes/kubernetes.io~projected/kube-api-access-pfwl6:{mountpoint:/var/lib/kubelet/pods/64de0045-bcde-40a0-938e-d2eeee30f20c/volumes/kubernetes.io~projected/kube-api-access-pfwl6 major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64de0045-bcde-40a0-938e-d2eeee30f20c/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/64de0045-bcde-40a0-938e-d2eeee30f20c/volumes/kubernetes.io~secret/cert major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea/volumes/kubernetes.io~projected/kube-api-access-mwt8q:{mountpoint:/var/lib/kubelet/pods/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea/volumes/kubernetes.io~projected/kube-api-access-mwt8q major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~projected/kube-api-access-6b4h2:{mountpoint:/var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~projected/kube-api-access-6b4h2 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36/volumes/kubernetes.io~projected/kube-api-access-lwzmt:{mountpoint:/var/lib/kubelet/pods/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36/volumes/kubernetes.io~projected/kube-api-access-lwzmt major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88847d7c-8749-4920-9c90-97f93bbfc432/volumes/kubernetes.io~projected/kube-api-access-fnd4f:{mountpoint:/var/lib/kubelet/pods/88847d7c-8749-4920-9c90-97f93bbfc432/volumes/kubernetes.io~projected/kube-api-access-fnd4f major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd/volumes/kubernetes.io~projected/kube-api-access-v5twf:{mountpoint:/var/lib/kubelet/pods/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd/volumes/kubernetes.io~projected/kube-api-access-v5twf major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ac16845-91f4-48c7-a02c-84fedf86171d/volumes/kubernetes.io~projected/kube-api-access-rgt5l:{mountpoint:/var/lib/kubelet/pods/8ac16845-91f4-48c7-a02c-84fedf86171d/volumes/kubernetes.io~projected/kube-api-access-rgt5l major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a64c6e47-3cf0-4453-b3e6-2657a66813e8/volumes/kubernetes.io~projected/kube-api-access-hftk2:{mountpoint:/var/lib/kubelet/pods/a64c6e47-3cf0-4453-b3e6-2657a66813e8/volumes/kubernetes.io~projected/kube-api-access-hftk2 major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~projected/kube-api-access-gqzz7:{mountpoint:/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~projected/kube-api-access-gqzz7 major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b232f810-709e-4360-9d38-3e968590bb08/volumes/kubernetes.io~projected/kube-api-access-thd4n:{mountpoint:/var/lib/kubelet/pods/b232f810-709e-4360-9d38-3e968590bb08/volumes/kubernetes.io~projected/kube-api-access-thd4n major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bf184a45-b70e-4fd6-9435-821fbeb133ba/volumes/kubernetes.io~projected/kube-api-access-zhrmz:{mountpoint:/var/lib/kubelet/pods/bf184a45-b70e-4fd6-9435-821fbeb133ba/volumes/kubernetes.io~projected/kube-api-access-zhrmz major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6f74c24-d57d-4296-b70d-631bd8eac394/volumes/kubernetes.io~projected/kube-api-access-zz7cw:{mountpoint:/var/lib/kubelet/pods/c6f74c24-d57d-4296-b70d-631bd8eac394/volumes/kubernetes.io~projected/kube-api-access-zz7cw major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d28bb413-77af-4b21-9ee8-489c521b4603/volumes/kubernetes.io~projected/kube-api-access-p56j6:{mountpoint:/var/lib/kubelet/pods/d28bb413-77af-4b21-9ee8-489c521b4603/volumes/kubernetes.io~projected/kube-api-access-p56j6 major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d28bb413-77af-4b21-9ee8-489c521b4603/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/d28bb413-77af-4b21-9ee8-489c521b4603/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/volumes/kubernetes.io~projected/kube-api-access-cjwjz:{mountpoint:/var/lib/kubelet/pods/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/volumes/kubernetes.io~projected/kube-api-access-cjwjz major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/volumes/kubernetes.io~secret/serving-cert major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5b373b2-2951-49d8-98a5-221c47b724c0/volumes/kubernetes.io~projected/kube-api-access-x7q2d:{mountpoint:/var/lib/kubelet/pods/e5b373b2-2951-49d8-98a5-221c47b724c0/volumes/kubernetes.io~projected/kube-api-access-x7q2d major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee06d536-e9ad-4690-87e1-3a82db673caa/volumes/kubernetes.io~projected/kube-api-access-zf99n:{mountpoint:/var/lib/kubelet/pods/ee06d536-e9ad-4690-87e1-3a82db673caa/volumes/kubernetes.io~projected/kube-api-access-zf99n major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee06d536-e9ad-4690-87e1-3a82db673caa/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/ee06d536-e9ad-4690-87e1-3a82db673caa/volumes/kubernetes.io~secret/signing-key major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc642127-45e3-46e5-897f-93b899a68127/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/fc642127-45e3-46e5-897f-93b899a68127/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~projected/kube-api-access-f7l8l:{mountpoint:/var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~projected/kube-api-access-f7l8l major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~secret/default-certificate major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~secret/stats-auth major:0 minor:205 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/e53fefcdc6f4fc2b3bad8ad1e40ad2b9de606e9a0642baacb8583a15ea4909dc/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/4ee4e1510c55aa76c22e4f289dd638dd2f91af7f138d51582cbdfb8ee0a422c3/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/b514a5a3674648bf2ffa0ef044a485f4e7d846af4a11fbc8cc29f85434c0affc/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/3c6a380973d0450a03495d0f0998f5d0456d2ee3ea72fb4f8eba997bb36813ed/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/4075ebb376ecf0f403cc594f1809a86be8da3c640047906613754716eb0d42d9/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/e5cc2f970c04c46e998d6ed6ed07f28d83b4fd6b76d0dca66735276d38da4e15/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/966cd55644964b95cd7504b937d544dd5d18fa1dd78f2c7a0073fe91b3f9121b/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/b0b4b4dc1d387929897d0989c378cc0b1ce272a753929df05dfbca501e412918/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/3b335a8b6afb2ed83a1e6b10821e601c825a1d154de03a877d5dbc50a87cefc1/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/7eed0417d228f84d8ff7a3b795579c8c357d1b2bf338346f46fa27cbdb3d795f/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/55b1d8b7901e9125096977a85bcf16ba59d4c8a75a71a401af939470d45a0938/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/643c4aa1afc353a234c6cd589143649df079117e15066af3fc99c98594ff2e0e/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/48022fcd51406937b78f8009301b048060062469ed4979d409879f9815046aba/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/c01b180d9b8e3247e4558e12b32b208b9dfc561ace5b0f15d51071a438d77cb8/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/8f9b2e6ba21c7493a9ba547c1d7f2bde96cc61d440bb22ca82df7c2ec0ae0eae/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/df7ed1fda23d1d3fc1b8393fa7e95a873f3141b7ca7d0292bc8efcc190fd588b/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/e070391d7565561a88e88c9e34b41b022dafa0b248536fced9a2ceefe6dd9ea6/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/ad0915bc1d78bb046826675c766f5b32110620ce635290997e31c7215b0d34fd/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/cc54e83a2e3718cbda191c1bb97aadad77696ac392f3bbe8011ff4a086359005/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/7821dd54e6dd0f7f517b27f938b9dfc0ed7c44e5a434e5319f63f51ed360d4d6/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/4cad3e09e77753171e7f889e18357d012aa11152ac546af35392dd48b61f2d94/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/c622c3a8302d0992caacaba60aed94f09b0af76da3f54360a813e95a966584f6/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/09bbd0b76e8ec181c9527a368c1e4b04acdf90550f750db7856c66dfe33af08f/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/50c1096173c449d402762e2dd96a6f9eb01749d5919cacd6883d4eaa870fb1be/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/40dcdab0f70d77e37e26888e95cbb7134e908d3a1b31d5cd1e6a3bd1ccd191b8/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/e6fc86cde99cccc3801dab6f89cea9dca66c8afef6cd4de4d13e8e498ed83ff8/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/34616ed28967a0fed120dd53221ec59c5764dbcfd21e67e0bff29ceae88d51aa/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/ca34de753fa45c85c4e933104ade3e9ed1da4e9b3412eea2f52f57e2bebdf8e7/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/f3c6f1c28d465be37688a73c2401657dfaf36625e75a5891a293dfe480f80f6f/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/93790e5d0fe66414cb6823488d9031b4d4e81bb05992942d6994cc82f8a93d63/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/e43d798884c88976a9fac134b0049fd11fdcbab3def5b9580d5d9c23f6c099cd/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/1e7bf25d11a96ca6366c99a63214be61f3a81ed4bd4496b3ee10614cbd2b73c9/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/1af045d1dfd5e47b3d77d5af0298f828360289aacf4e076d93c2d7e0ef115839/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/4a1af7868013b12ae5c72943f6110b06b1edef8bbe0983ccbbfaf3b3671ae696/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/a9a9ec70a375a7e1dfa220f83839ae4f1880d89b8205fe4791f0dcc6be6b78db/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/325f041a57cecb964c87686cfb17254190dd39d8839718f1b8a9d4cc81f86b83/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/06a1606b6d6c062a8492fdf88066f61f2a83c4c9fc018914e606599818424ac0/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/da92f9b2bc840f1bd10a717e68322d0d3bf010dc4945dbf2597998ee9d6b78c4/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/8ec029482c849224a95b8360ec612e0e06f5922eb277548024b87cf744216c25/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/c2822bffb4ac1b4d116f489e6c7d88c591745e871be72a63e9bd999c933c4b57/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/a690628c75623727bba8f08fb941294d7beb819042ccfb652100b6f04242769f/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/62e455dd9863f8933409a09501d54360ed0757bf44ad27246ef5f0e13db3aad0/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-342:{mountpoint:/var/lib/containers/storage/overlay/7dc607e54af22e1c247b02841827bf8253dbdade25ee1b174b9c8e49f9b7bf3f/merged major:0 minor:342 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/6bb2a3274b522239152fe823f5e40acbf8aa4f3deddc2b339bc5ae9005098f72/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/65acc1d47da516cf59c7ceebfceda7f874365f2dd51b9c8681c528a252695402/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/0d7fb8cddeb9bd25be803586667b6c66f4fb3c12e8d5cfddf3ae946acf81a481/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/8450c43ac144415a9596c2ba7b69f61f5ccce9c505f150fc5701f1a21db22a29/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/5a5bad40b346567b17b175fd18cef1b377bf6297ee01aade49a72fb8971064bb/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/43de5d65a3a283d84ad4e03fbdfc7b03c4dfd0af49bf5e8f26c90f9dca3b3893/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/b4b0c94344f59c70eb431b6a503bcd215ab140ef160cb2b6c0cacfecd7fd8ad1/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/9a9804f67c69e2743a9718836ee521b157f8cc1d932700969197f23951f79d72/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/387c41768276cff3fd897f4467307d92de5b94bfd2bd49515ead980bee916733/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/c4526b33af8b39ad9716fd29ac3518e0b935895484b00d22a73376a94a2ab37c/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/73ec2da4b678641054e9ee9166cf3ff90f048ea55b0b52018f4c2a0e5c55fb4b/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/656aa8841187c03b309387a4e09c3d7ddac32ef215d8462d12e38c8850ad52f2/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/fc79d6e561b569a0f6e29bec6892596e4ffbe6483127401925c5be7dbaf91528/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/5a3a8e9605adbd0f4fb19a2e1a68ce2d936be83fb9eced63438c74aba7bed44b/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/469cffa3a453e4a24987170ac3979df5ae45a67bde3521fc95b2aa4ff7242e15/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/519f0507488800e6870b63a793ff6481a56a450971ab29327a0525f45ac9f51f/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/d945ced7ff333c692601eae296e90c4e8bf417e9dc5fe5193791b04636f9f72d/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/3d2cded51c14106db76d95e2c27dbe9cdddaf6fc27c8d044d09e0bd17b0f88d7/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/c16fc0ac5df8ef0142b14af51516e7bcbe13688fc5bf8193add2f74e5b0dccea/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.018865    5101 manager.go:217] Machine: {Timestamp:2026-10-30 16:19:41.018328845 +0000 UTC m=+0.071606448 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100271 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ff90025f36d33463445823222b29 SystemUUID:ec20ff90-025f-36d3-3463-445823222b29 BootID:a47d33aa-a1cb-4a12-b210-6dd1ceae15a9 Filesystems:[{Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~projected/kube-api-access-5t5zt DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64de0045-bcde-40a0-938e-d2eeee30f20c/volumes/kubernetes.io~projected/kube-api-access-pfwl6 DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3dd6c0df-eb3d-4433-839e-abdf00f47695/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5cb59c3405e961cf93da617bc6bb669f227669021f0e662ca734bd0f8a9ae19a/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/52e59496-41f2-430d-8c96-467b3ef3a839/volumes/kubernetes.io~projected/kube-api-access-jn92z DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~projected/kube-api-access-gqzz7 DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f807fa47632726c046e6f82b99def2a4d97328e96c65f3f242dcb2986b5b1830/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/30f743ff-35c0-42c8-9ab1-422606471aa0/volumes/kubernetes.io~projected/kube-api-access-lmhzz DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/volumes/kubernetes.io~projected/kube-api-access-cjwjz DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/17bcd7b8-e377-451f-809b-9887d5b937e2/volumes/kubernetes.io~projected/kube-api-access-nq84b DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e5b373b2-2951-49d8-98a5-221c47b724c0/volumes/kubernetes.io~projected/kube-api-access-x7q2d DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a64c6e47-3cf0-4453-b3e6-2657a66813e8/volumes/kubernetes.io~projected/kube-api-access-hftk2 DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5fc302ebcd39fbe4c3f04b33e4231b8f239b3300a15366fc2796ad87cbb8b71e/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d7a199c4b6899687dc5a371143f408b5a1a1f5f3d6ac5160a5677795c4ae860e/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5dcd8fb6-aaea-456a-bf39-c58f04323aee/volumes/kubernetes.io~projected/kube-api-access-rs9s4 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c18912c0f94b715c3267103571a0e4bba6c0c6c2fef7a458c7446570a655080e/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0e3b7e2c04d7fda3dabd74c61789b3fba225f3f48479fa3dd7785dfc0024e46a/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9283917c899282cf2576c5b0bb37d5a312004bfa485a043f0312080974ab45f6/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4329d3424d0d4ee8a9767df4c9e7312f6a2f114b061e3725c98aabbe9032db68/userdata/shm DeviceMajor:0 DeviceMinor:362 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8ac16845-91f4-48c7-a02c-84fedf86171d/volumes/kubernetes.io~projected/kube-api-access-rgt5l DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d28bb413-77af-4b21-9ee8-489c521b4603/volumes/kubernetes.io~projected/kube-api-access-p56j6 DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b26104cdf7e8270b1eaa4fb0491c726cac32f0eb3f50ebf4fd8501e14ad6a0c/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fc642127-45e3-46e5-897f-93b899a68127/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1a9c91d9f6b201a2225c2b51bd9239b242acc35a9694e1300e8de9d2cfbfefa2/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9fa913dabf362be3c185a12c28163cf454336c062705dd3388a9ab70be7c15f9/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3dd6c0df-eb3d-4433-839e-abdf00f47695/volumes/kubernetes.io~projected/kube-api-access-7ssmb DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/548f7cd0-4adf-403f-b879-fb8be191d374/volumes/kubernetes.io~projected/kube-api-access-vzqv8 DeviceMajor:0 DeviceMinor:310 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3fb1fc6577a596f525550cdb6fe7e9d3b25c228ff303fdb46008002228c3b2be/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/41c538db-7de5-4e4d-ba29-d329164990cd/volumes/kubernetes.io~projected/kube-api-access-s2xq6 DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-342 DeviceMajor:0 DeviceMinor:342 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/37d06c87-6ddd-4605-9322-9e13e26eaaa4/volumes/kubernetes.io~projected/kube-api-access-sqcch DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9b8a91ff6a74ffe62dd6cd94ce4920bab0f5b928414b3e0e88e778e922e4d05d/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ee06d536-e9ad-4690-87e1-3a82db673caa/volumes/kubernetes.io~projected/kube-api-access-zf99n DeviceMajor:0 DeviceMinor:361 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e73996eb8296158509bed53e8ecf389b5475dbe41a9fe4026dbcf52f5d89872/userdata/shm DeviceMajor:0 DeviceMinor:328 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/60021494faea99c67a259ce5d5dfc419c7a1fa8ee0f0efd544436098df728a87/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690/volumes/kubernetes.io~projected/kube-api-access-sw6dq DeviceMajor:0 DeviceMinor:338 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fcb660ae-8c6a-42ec-bd90-484b9497250b/volumes/kubernetes.io~projected/kube-api-access-f7l8l DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7da9c9e54c0ce6ce7ce4b284f481d1036b6b47ce24b1b23829cacf57f82951ee/userdata/shm DeviceMajor:0 DeviceMinor:49 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/88847d7c-8749-4920-9c90-97f93bbfc432/volumes/kubernetes.io~projected/kube-api-access-fnd4f DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a588c649891157755aaa0f9438940cfa38c1b2966f674ef0a0f591898e3f731e/userdata/shm DeviceMajor:0 DeviceMinor:332 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/538fc6c88ee927324db73ef308984085f2aa25139f0b20fec72315d7468bb5a9/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5bc3e51aef3ab8db5a6575b7dc2dce6a3264a9caf95154f05f21ae42b9e8e12d/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d28bb413-77af-4b21-9ee8-489c521b4603/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0a402821-d2bd-4ebe-a4cb-897a5b3f4625/volumes/kubernetes.io~projected/kube-api-access-d8hr4 DeviceMajor:0 DeviceMinor:327 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36/volumes/kubernetes.io~projected/kube-api-access-lwzmt DeviceMajor:0 DeviceMinor:293 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d596ea12afbbf2cb5d36622f7eab65621f19977456e668158fb66217b34dd2a4/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/10e23d4f-4633-46b8-882f-3acabfb8a3f1/volumes/kubernetes.io~projected/kube-api-access-98tr6 DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3e2e4037dfb46a27d7321dea36a833499cca12bf1e293ea1da6e69969eb66010/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64de0045-bcde-40a0-938e-d2eeee30f20c/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/22bd7f2a-ce4d-4888-a8bb-521657c81151/volumes/kubernetes.io~projected/kube-api-access-7v9bm DeviceMajor:0 DeviceMinor:337 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd/volumes/kubernetes.io~projected/kube-api-access-v5twf DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/72d0587f87aed62b45d0c825a89092a1f4a07253ae993565b5ccaad3893d8521/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c25eb76abe89bcfa3582e7e1b6776591795b0a0dee3116798ecba2fa6b294d66/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b232f810-709e-4360-9d38-3e968590bb08/volumes/kubernetes.io~projected/kube-api-access-thd4n DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1a9dbaff1ffd908b9d83c5f87409074f2ad2e55f77beafcdf152705fbd41bf5f/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/72030764-3f04-44d3-97fe-3d0da005a6a2/volumes/kubernetes.io~projected/kube-api-access-6b4h2 DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c6f74c24-d57d-4296-b70d-631bd8eac394/volumes/kubernetes.io~projected/kube-api-access-zz7cw DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bf184a45-b70e-4fd6-9435-821fbeb133ba/volumes/kubernetes.io~projected/kube-api-access-zhrmz DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/18405f154efaa4d5a42ba294e4847a893ecf2fb1a38bc5ce2333dac77487eada/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea/volumes/kubernetes.io~projected/kube-api-access-mwt8q DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/162586301f0fea5cf3bda7b123888ed26870f412cabdf7bddfb130a2f5877e3e/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5806cd90-2896-488a-ac38-10fc6d959026/volumes/kubernetes.io~projected/kube-api-access-zw7qz DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ee06d536-e9ad-4690-87e1-3a82db673caa/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:360 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0b26104cdf7e827 MacAddress:1e:9b:c4:dc:4c:8a Speed:10000 Mtu:8901} {Name:0e3b7e2c04d7fda MacAddress:ce:84:34:61:d6:0f Speed:10000 Mtu:8901} {Name:162586301f0fea5 MacAddress:7e:2c:09:c5:1d:60 Speed:10000 Mtu:8901} {Name:18405f154efaa4d MacAddress:ae:66:2a:61:5b:97 Speed:10000 Mtu:8901} {Name:1a9dbaff1ffd908 MacAddress:52:f8:54:b7:ed:b7 Speed:10000 Mtu:8901} {Name:3fb1fc6577a596f MacAddress:d6:0a:34:40:67:32 Speed:10000 Mtu:8901} {Name:4329d3424d0d4ee MacAddress:42:ad:fb:a1:03:cf Speed:10000 Mtu:8901} {Name:5cb59c3405e961c MacAddress:ce:bd:f8:0b:7e:97 Speed:10000 Mtu:8901} {Name:5e73996eb829615 MacAddress:36:ba:d5:3d:2c:da Speed:10000 Mtu:8901} {Name:5fc302ebcd39fbe MacAddress:1e:51:27:b6:3a:54 Speed:10000 Mtu:8901} {Name:60021494faea99c MacAddress:6e:91:04:b0:ad:d6 Speed:10000 Mtu:8901} {Name:72d0587f87aed62 MacAddress:aa:17:bb:c2:37:ba Speed:10000 Mtu:8901} {Name:9283917c899282c MacAddress:96:24:7a:5d:b5:a6 Speed:10000 Mtu:8901} {Name:a588c6498911577 MacAddress:0a:5f:8d:e7:ce:cb Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d9:f4:41:ab Speed:0 Mtu:9001} {Name:br-int MacAddress:ea:60:f1:bf:bd:6a Speed:0 Mtu:8901} {Name:c25eb76abe89bcf MacAddress:7e:fe:93:85:64:6c Speed:10000 Mtu:8901} {Name:d596ea12afbbf2c MacAddress:62:3a:6b:51:a3:a2 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d9:f4:41:ab Speed:0 Mtu:9001} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:46:7d:37:34:a9:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019293    5101 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019365    5101 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019731    5101 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019756    5101 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019889    5101 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019895    5101 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019909    5101 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019922    5101 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.019942    5101 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.020100    5101 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.020208    5101 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.020243    5101 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.020252    5101 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.020267    5101 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.020277    5101 kubelet.go:405] "Adding apiserver pod source"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.020285    5101 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.021425    5101 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.021439    5101 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.022019    5101 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.024572    5101 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.024582    5101 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.024679    5101 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.024872    5101 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.024900    5101 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.024998    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025015    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025026    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025037    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025045    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025056    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025062    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025068    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025075    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025080    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025093    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025102    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025131    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.025141    5101 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.028771    5101 server.go:1263] "Started kubelet"
Oct 30 16:19:41.031454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.028826    5101 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 16:19:41.033487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.031799    5101 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 16:19:41.033487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.031920    5101 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 16:19:41.033487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.032516    5101 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 16:19:41.035143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.034743    5101 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 16:19:41.035143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.034957    5101 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 16:19:41.035293 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.035189    5101 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 16:19:41.035293 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.035201    5101 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 16:19:41.035950 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.035635    5101 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 16:19:41.035950 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.035690    5101 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 16:14:02 +0000 UTC" deadline="2028-06-13 17:07:29.325649225 +0000 UTC"
Oct 30 16:19:41.035950 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.035726    5101 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14208h47m48.289927004s"
Oct 30 16:19:41.035950 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.035748    5101 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 16:19:41.035950 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:41.035789    5101 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-40.ec2.internal\" not found"
Oct 30 16:19:41.037098 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.037079    5101 factory.go:55] Registering systemd factory
Oct 30 16:19:41.037098 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.037098    5101 factory.go:223] Registration of the systemd container factory successfully
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.038664    5101 factory.go:153] Registering CRI-O factory
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.038681    5101 factory.go:223] Registration of the crio container factory successfully
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.038738    5101 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.038761    5101 factory.go:103] Registering Raw factory
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.038782    5101 manager.go:1199] Started watching for new ooms in manager
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039112    5101 manager.go:319] Starting recovery of all containers
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039548    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fcb660ae-8c6a-42ec-bd90-484b9497250b" volumeName="kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-default-certificate" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039583    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afdf3517-540a-470f-b111-043df8f007c5" volumeName="kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039597    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30f743ff-35c0-42c8-9ab1-422606471aa0" volumeName="kubernetes.io/configmap/30f743ff-35c0-42c8-9ab1-422606471aa0-config-volume" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039610    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30f743ff-35c0-42c8-9ab1-422606471aa0" volumeName="kubernetes.io/projected/30f743ff-35c0-42c8-9ab1-422606471aa0-kube-api-access-lmhzz" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039624    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3dd6c0df-eb3d-4433-839e-abdf00f47695" volumeName="kubernetes.io/projected/3dd6c0df-eb3d-4433-839e-abdf00f47695-kube-api-access-7ssmb" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039636    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="548f7cd0-4adf-403f-b879-fb8be191d374" volumeName="kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039647    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afdf3517-540a-470f-b111-043df8f007c5" volumeName="kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039658    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b232f810-709e-4360-9d38-3e968590bb08" volumeName="kubernetes.io/projected/b232f810-709e-4360-9d38-3e968590bb08-kube-api-access-thd4n" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039676    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee06d536-e9ad-4690-87e1-3a82db673caa" volumeName="kubernetes.io/configmap/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-cabundle" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039689    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="37d06c87-6ddd-4605-9322-9e13e26eaaa4" volumeName="kubernetes.io/empty-dir/37d06c87-6ddd-4605-9322-9e13e26eaaa4-tmp-dir" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039715    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5806cd90-2896-488a-ac38-10fc6d959026" volumeName="kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039726    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5806cd90-2896-488a-ac38-10fc6d959026" volumeName="kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039738    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72030764-3f04-44d3-97fe-3d0da005a6a2" volumeName="kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-tuned" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039749    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fcb660ae-8c6a-42ec-bd90-484b9497250b" volumeName="kubernetes.io/projected/fcb660ae-8c6a-42ec-bd90-484b9497250b-kube-api-access-f7l8l" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039764    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afdf3517-540a-470f-b111-043df8f007c5" volumeName="kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039776    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="548f7cd0-4adf-403f-b879-fb8be191d374" volumeName="kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039791    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="659d22c7-e8bf-48e3-a6e8-54f4e2e77cea" volumeName="kubernetes.io/secret/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-serving-cert" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039802    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36" volumeName="kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039813    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afdf3517-540a-470f-b111-043df8f007c5" volumeName="kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039825    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28bb413-77af-4b21-9ee8-489c521b4603" volumeName="kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-snapshots" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039848    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28bb413-77af-4b21-9ee8-489c521b4603" volumeName="kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-tmp" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039860    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee06d536-e9ad-4690-87e1-3a82db673caa" volumeName="kubernetes.io/projected/ee06d536-e9ad-4690-87e1-3a82db673caa-kube-api-access-zf99n" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039872    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd" volumeName="kubernetes.io/projected/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-kube-api-access-v5twf" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039884    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa" volumeName="kubernetes.io/projected/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-kube-api-access-cjwjz" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039895    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5b373b2-2951-49d8-98a5-221c47b724c0" volumeName="kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-cni-binary-copy" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039907    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc642127-45e3-46e5-897f-93b899a68127" volumeName="kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039932    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fcb660ae-8c6a-42ec-bd90-484b9497250b" volumeName="kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-stats-auth" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039945    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a402821-d2bd-4ebe-a4cb-897a5b3f4625" volumeName="kubernetes.io/projected/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-api-access-d8hr4" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039962    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b6aeef2-7878-466d-964c-2a375bdb8f04" volumeName="kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039974    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72030764-3f04-44d3-97fe-3d0da005a6a2" volumeName="kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-tmp" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039986    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88847d7c-8749-4920-9c90-97f93bbfc432" volumeName="kubernetes.io/projected/88847d7c-8749-4920-9c90-97f93bbfc432-kube-api-access-fnd4f" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.039998    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afdf3517-540a-470f-b111-043df8f007c5" volumeName="kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040023    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749" volumeName="kubernetes.io/secret/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-agent-certs" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040035    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5b373b2-2951-49d8-98a5-221c47b724c0" volumeName="kubernetes.io/projected/e5b373b2-2951-49d8-98a5-221c47b724c0-kube-api-access-x7q2d" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040049    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a402821-d2bd-4ebe-a4cb-897a5b3f4625" volumeName="kubernetes.io/empty-dir/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-data-volume" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040061    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10e23d4f-4633-46b8-882f-3acabfb8a3f1" volumeName="kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-config" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040074    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10e23d4f-4633-46b8-882f-3acabfb8a3f1" volumeName="kubernetes.io/secret/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040099    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52e59496-41f2-430d-8c96-467b3ef3a839" volumeName="kubernetes.io/projected/52e59496-41f2-430d-8c96-467b3ef3a839-kube-api-access-jn92z" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040113    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64de0045-bcde-40a0-938e-d2eeee30f20c" volumeName="kubernetes.io/projected/64de0045-bcde-40a0-938e-d2eeee30f20c-kube-api-access-pfwl6" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040124    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="659d22c7-e8bf-48e3-a6e8-54f4e2e77cea" volumeName="kubernetes.io/configmap/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-config" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040139    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64de0045-bcde-40a0-938e-d2eeee30f20c" volumeName="kubernetes.io/secret/64de0045-bcde-40a0-938e-d2eeee30f20c-cert" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040151    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ac16845-91f4-48c7-a02c-84fedf86171d" volumeName="kubernetes.io/projected/8ac16845-91f4-48c7-a02c-84fedf86171d-kube-api-access-rgt5l" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040169    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa" volumeName="kubernetes.io/secret/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-serving-cert" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040181    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b6aeef2-7878-466d-964c-2a375bdb8f04" volumeName="kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040193    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10e23d4f-4633-46b8-882f-3acabfb8a3f1" volumeName="kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-env-overrides" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040217    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10e23d4f-4633-46b8-882f-3acabfb8a3f1" volumeName="kubernetes.io/projected/10e23d4f-4633-46b8-882f-3acabfb8a3f1-kube-api-access-98tr6" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040230    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41c538db-7de5-4e4d-ba29-d329164990cd" volumeName="kubernetes.io/configmap/41c538db-7de5-4e4d-ba29-d329164990cd-telemetry-config" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040251    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="548f7cd0-4adf-403f-b879-fb8be191d374" volumeName="kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040264    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5dcd8fb6-aaea-456a-bf39-c58f04323aee" volumeName="kubernetes.io/projected/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kube-api-access-rs9s4" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040277    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afdf3517-540a-470f-b111-043df8f007c5" volumeName="kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040289    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749" volumeName="kubernetes.io/configmap/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-konnectivity-ca" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040301    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10e23d4f-4633-46b8-882f-3acabfb8a3f1" volumeName="kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040315    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5806cd90-2896-488a-ac38-10fc6d959026" volumeName="kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-binary-copy" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040329    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72030764-3f04-44d3-97fe-3d0da005a6a2" volumeName="kubernetes.io/projected/72030764-3f04-44d3-97fe-3d0da005a6a2-kube-api-access-6b4h2" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040357    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afdf3517-540a-470f-b111-043df8f007c5" volumeName="kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040372    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee06d536-e9ad-4690-87e1-3a82db673caa" volumeName="kubernetes.io/secret/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-key" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040408    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3dd6c0df-eb3d-4433-839e-abdf00f47695" volumeName="kubernetes.io/configmap/3dd6c0df-eb3d-4433-839e-abdf00f47695-config" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040420    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3dd6c0df-eb3d-4433-839e-abdf00f47695" volumeName="kubernetes.io/secret/3dd6c0df-eb3d-4433-839e-abdf00f47695-serving-cert" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040434    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="548f7cd0-4adf-403f-b879-fb8be191d374" volumeName="kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040448    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ac16845-91f4-48c7-a02c-84fedf86171d" volumeName="kubernetes.io/configmap/8ac16845-91f4-48c7-a02c-84fedf86171d-iptables-alerter-script" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040461    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b232f810-709e-4360-9d38-3e968590bb08" volumeName="kubernetes.io/configmap/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-config" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040474    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf184a45-b70e-4fd6-9435-821fbeb133ba" volumeName="kubernetes.io/projected/bf184a45-b70e-4fd6-9435-821fbeb133ba-kube-api-access-zhrmz" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040485    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6f74c24-d57d-4296-b70d-631bd8eac394" volumeName="kubernetes.io/projected/c6f74c24-d57d-4296-b70d-631bd8eac394-kube-api-access-zz7cw" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040498    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa" volumeName="kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-config" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040513    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="17bcd7b8-e377-451f-809b-9887d5b937e2" volumeName="kubernetes.io/projected/17bcd7b8-e377-451f-809b-9887d5b937e2-kube-api-access-nq84b" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040525    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="37d06c87-6ddd-4605-9322-9e13e26eaaa4" volumeName="kubernetes.io/projected/37d06c87-6ddd-4605-9322-9e13e26eaaa4-kube-api-access-sqcch" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040538    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b6aeef2-7878-466d-964c-2a375bdb8f04" volumeName="kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040552    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b6aeef2-7878-466d-964c-2a375bdb8f04" volumeName="kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040565    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd" volumeName="kubernetes.io/configmap/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-serviceca" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040580    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f1110bc-3087-4f49-9e1c-5371b8c85d09" volumeName="kubernetes.io/configmap/9f1110bc-3087-4f49-9e1c-5371b8c85d09-nginx-conf" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040594    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5b373b2-2951-49d8-98a5-221c47b724c0" volumeName="kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-daemon-config" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040608    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b6aeef2-7878-466d-964c-2a375bdb8f04" volumeName="kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040622    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28bb413-77af-4b21-9ee8-489c521b4603" volumeName="kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-service-ca-bundle" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040635    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30f743ff-35c0-42c8-9ab1-422606471aa0" volumeName="kubernetes.io/empty-dir/30f743ff-35c0-42c8-9ab1-422606471aa0-tmp-dir" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040653    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41c538db-7de5-4e4d-ba29-d329164990cd" volumeName="kubernetes.io/projected/41c538db-7de5-4e4d-ba29-d329164990cd-kube-api-access-s2xq6" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040667    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28bb413-77af-4b21-9ee8-489c521b4603" volumeName="kubernetes.io/projected/d28bb413-77af-4b21-9ee8-489c521b4603-kube-api-access-p56j6" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040682    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28bb413-77af-4b21-9ee8-489c521b4603" volumeName="kubernetes.io/secret/d28bb413-77af-4b21-9ee8-489c521b4603-serving-cert" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040695    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22bd7f2a-ce4d-4888-a8bb-521657c81151" volumeName="kubernetes.io/projected/22bd7f2a-ce4d-4888-a8bb-521657c81151-kube-api-access-7v9bm" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040708    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b6aeef2-7878-466d-964c-2a375bdb8f04" volumeName="kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040721    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b6aeef2-7878-466d-964c-2a375bdb8f04" volumeName="kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040736    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5806cd90-2896-488a-ac38-10fc6d959026" volumeName="kubernetes.io/projected/5806cd90-2896-488a-ac38-10fc6d959026-kube-api-access-zw7qz" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040750    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a64c6e47-3cf0-4453-b3e6-2657a66813e8" volumeName="kubernetes.io/projected/a64c6e47-3cf0-4453-b3e6-2657a66813e8-kube-api-access-hftk2" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040762    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28bb413-77af-4b21-9ee8-489c521b4603" volumeName="kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040775    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa" volumeName="kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-trusted-ca" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040786    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690" volumeName="kubernetes.io/projected/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690-kube-api-access-sw6dq" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040799    5101 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="659d22c7-e8bf-48e3-a6e8-54f4e2e77cea" volumeName="kubernetes.io/projected/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-kube-api-access-mwt8q" seLinuxMountContext=""
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040811    5101 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 16:19:41.041863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.040819    5101 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 16:19:41.064434 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.064318    5101 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 16:19:41.066283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.066258    5101 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 16:19:41.066283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.066283    5101 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 16:19:41.066436 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.066305    5101 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 16:19:41.066436 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:41.066359    5101 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 16:19:41.066973 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.066950    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:19:41.068042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.068025    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:19:41.074491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.074472    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:19:41.074978 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.074957    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:19:41.084298 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.084268    5101 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 16:19:41.084999 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.084977    5101 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:41.085573 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.085554    5101 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:41.088599 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.088575    5101 generic.go:356] "Generic (PLEG): container finished" podID="12fb9ae397c79a585da42d7d21f809ee" containerID="28f614d8efafd7d6f5da0b7f58efa2af636682564d55d7025caa8726feab9afa" exitCode=0
Oct 30 16:19:41.093237 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.093216    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:19:41.093317 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.093248    5101 generic.go:356] "Generic (PLEG): container finished" podID="d5b9aacd-cd48-4496-a43a-ce89ff7a29fa" containerID="1f13a1bbb1950524457cdc79dcdd92cef71cec9bdd41f7949640c3c77e41c508" exitCode=255
Oct 30 16:19:41.097543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.097497    5101 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:41.097727 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.097708    5101 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:41.101832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.101810    5101 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="5e77c4fb1bae2123a0ab25e4408e8a1ddc850abd401d2defa4a47d1b3f7deb04" exitCode=0
Oct 30 16:19:41.101832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.101829    5101 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="5fa75b9b6aebecfc62095c7768b22049b6c977458c53784d6f4194b1742711e5" exitCode=0
Oct 30 16:19:41.101980 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.101836    5101 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="1f8704cf0c166f19630443e476dfa05729a963b1dd608e53f1a62670d6ac7e94" exitCode=0
Oct 30 16:19:41.101980 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.101843    5101 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="f37f4bcf71f13810bee53bd158b007018d82c6a73bf44d86a42f47e4f4e6e5bc" exitCode=0
Oct 30 16:19:41.101980 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.101851    5101 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="d038e7a151950672e47659405079e3ed4dd301aec8192ff617ff5c86f640baf2" exitCode=0
Oct 30 16:19:41.101980 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.101856    5101 generic.go:356] "Generic (PLEG): container finished" podID="5806cd90-2896-488a-ac38-10fc6d959026" containerID="43e7c14b41b98c43f580524cf860538f9b658e932b7001838cd638e71913a368" exitCode=0
Oct 30 16:19:41.126069 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.126038    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:19:41.126421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.126392    5101 generic.go:356] "Generic (PLEG): container finished" podID="10e23d4f-4633-46b8-882f-3acabfb8a3f1" containerID="2307f3940c1e9f31b56bc5dbec7081335f2eec7006bf435955aa401f63ac4ee6" exitCode=1
Oct 30 16:19:41.149498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.149470    5101 manager.go:324] Recovery completed
Oct 30 16:19:41.166438 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:41.166408    5101 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 16:19:41.170427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170406    5101 cpu_manager.go:226] "Starting" policy="none"
Oct 30 16:19:41.170427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170422    5101 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 16:19:41.170574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170440    5101 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 16:19:41.170574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170560    5101 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 16:19:41.170629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170570    5101 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 16:19:41.170629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170588    5101 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 16:19:41.170629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170593    5101 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 16:19:41.170629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170599    5101 policy_none.go:50] "Start"
Oct 30 16:19:41.170629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170606    5101 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 16:19:41.170629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.170615    5101 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 16:19:41.178218 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.178200    5101 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 16:19:41.178218 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.178216    5101 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 16:19:41.178328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.178224    5101 policy_none.go:44] "Start"
Oct 30 16:19:41.182558 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.182524    5101 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 16:19:41.187469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.187452    5101 manager.go:341] "Starting Device Plugin manager"
Oct 30 16:19:41.187596 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:41.187488    5101 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 16:19:41.187596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.187500    5101 server.go:87] "Starting device plugin registration server"
Oct 30 16:19:41.187823 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.187810    5101 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 16:19:41.187853 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.187830    5101 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 16:19:41.187948 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.187931    5101 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 16:19:41.188059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.188026    5101 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 16:19:41.188142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.188067    5101 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 16:19:41.188142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.188074    5101 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 16:19:41.188233 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.188123    5101 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T16:19:41.188056781Z","UUID":"7adb61f2-6642-42d9-9b17-1f760fdec254","Handler":null,"Name":"","Endpoint":""}
Oct 30 16:19:41.189444 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.189426    5101 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 16:19:41.189550 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.189451    5101 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 16:19:41.191381 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:41.191184    5101 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 16:19:41.288456 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.288373    5101 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:41.289827 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.289809    5101 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:41.289903 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.289840    5101 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:41.289903 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.289854    5101 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-40.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:41.289903 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.289898    5101 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.329768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.329741    5101 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.329872 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.329816    5101 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.367029 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.366978    5101 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"]
Oct 30 16:19:41.367607 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.367564    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal" event={"ID":"5516ee241b7eda607841dfd15963de2b","Type":"ContainerStarted","Data":"8dc8134a66a5bbec2c7166dfddda33870899c45823c50f4ccddf9b6eb09c0336"}
Oct 30 16:19:41.367607 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.367607    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal" event={"ID":"5516ee241b7eda607841dfd15963de2b","Type":"ContainerStarted","Data":"7da9c9e54c0ce6ce7ce4b284f481d1036b6b47ce24b1b23829cacf57f82951ee"}
Oct 30 16:19:41.367789 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.367620    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal" event={"ID":"12fb9ae397c79a585da42d7d21f809ee","Type":"ContainerStarted","Data":"c0a089965b6b60dc9bae3c245731e006d5e8213ae648d48ee12efb08b9a7e137"}
Oct 30 16:19:41.367789 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.367637    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal" event={"ID":"12fb9ae397c79a585da42d7d21f809ee","Type":"ContainerDied","Data":"28f614d8efafd7d6f5da0b7f58efa2af636682564d55d7025caa8726feab9afa"}
Oct 30 16:19:41.367789 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.367654    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal" event={"ID":"12fb9ae397c79a585da42d7d21f809ee","Type":"ContainerStarted","Data":"d7a199c4b6899687dc5a371143f408b5a1a1f5f3d6ac5160a5677795c4ae860e"}
Oct 30 16:19:41.367789 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.367585    5101 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.367986 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.367826    5101 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.392143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.392117    5101 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:19:41.392257 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:41.392165    5101 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-40.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.392736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.392720    5101 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:19:41.392772 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:41.392758    5101 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.486493 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.486452    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5516ee241b7eda607841dfd15963de2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-40.ec2.internal\" (UID: \"5516ee241b7eda607841dfd15963de2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.486656 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.486499    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.486656 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.486528    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.587646 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.587551    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5516ee241b7eda607841dfd15963de2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-40.ec2.internal\" (UID: \"5516ee241b7eda607841dfd15963de2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.587646 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.587570    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5516ee241b7eda607841dfd15963de2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-40.ec2.internal\" (UID: \"5516ee241b7eda607841dfd15963de2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.587646 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.587616    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.587646 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.587642    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.587887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.587691    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:41.587887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:41.587712    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12fb9ae397c79a585da42d7d21f809ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" (UID: \"12fb9ae397c79a585da42d7d21f809ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:42.020755 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.020723    5101 apiserver.go:52] "Watching apiserver"
Oct 30 16:19:42.079217 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.079188    5101 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 16:19:42.079931 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.079901    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal","openshift-insights/insights-runtime-extractor-wkcqh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8","kube-system/global-pull-secret-syncer-4xnzd","kube-system/kas-connection-checker-685895c7c9-95hdf","openshift-dns/node-resolver-k4b9s","openshift-image-registry/image-registry-7869764d77-758qx","openshift-dns/dns-default-l8nf9","openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw","openshift-multus/multus-2clff","openshift-cluster-node-tuning-operator/tuned-82qt4","openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88","openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk","openshift-service-ca/service-ca-5fffc97bdf-nvmr7","openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng","openshift-image-registry/node-ca-9s5vn","openshift-insights/insights-operator-7c4986d449-zfp2k","kube-system/kas-connection-checker-685895c7c9-n4sp2","openshift-insights/periodic-gathering-b82vr-4mwk6","openshift-multus/multus-additional-cni-plugins-dlcgr","kube-system/konnectivity-agent-bvzgm","openshift-network-console/networking-console-plugin-86c478bb88-kjxhd","openshift-ingress-canary/ingress-canary-rbczx","openshift-console-operator/console-operator-7cd56b8dbc-ml6q4","openshift-multus/network-metrics-daemon-rttw4","openshift-image-registry/image-registry-768cfdff76-wxc2q","kube-system/kas-connection-checker-685895c7c9-s7lhf","openshift-network-operator/iptables-alerter-xl9bk","kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc","openshift-ingress/router-default-9f769b7d5-g6vn9","openshift-network-diagnostics/network-check-target-7c4px","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8","openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh","openshift-ovn-kubernetes/ovnkube-node-jxtgs"]
Oct 30 16:19:42.081371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.081334    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.082011 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.081992    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.082425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.082405    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:42.082730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.082712    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.084626 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.084611    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:42.085006 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.084989    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:42.094716 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.094660    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.094817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.094778    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.096143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096038    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.096143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096039    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.096143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096108    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 16:19:42.096430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096287    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 16:19:42.096430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096309    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.096430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096318    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.096430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096397    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.096798 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096776    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.096906 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096888    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7g4mc\""
Oct 30 16:19:42.096959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096930    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 16:19:42.096959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096883    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 16:19:42.096959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096838    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 16:19:42.097097 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.096988    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 16:19:42.097097 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.097067    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.097296 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.097277    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tbf7f\""
Oct 30 16:19:42.097378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.097362    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mzzhs\""
Oct 30 16:19:42.097710 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.097697    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 16:19:42.098701 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.098683    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.102638 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.102618    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 16:19:42.102778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.102657    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.102778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.102760    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 16:19:42.102857 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.102804    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 16:19:42.102925 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.102908    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.103053 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.103037    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.103104 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.103061    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 16:19:42.103104 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.103076    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-svxjg\""
Oct 30 16:19:42.103104 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.103079    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.103104 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.103099    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.103312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.103294    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 16:19:42.104283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104267    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 16:19:42.104396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104302    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 16:19:42.104396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104355    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 16:19:42.104628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104615    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 16:19:42.104697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104684    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 16:19:42.104741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104684    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 16:19:42.104741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104698    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 16:19:42.104741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104713    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.104741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.104713    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 16:19:42.106865 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.106853    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.106905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.106875    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.107203 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.107183    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.107203 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.107191    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 16:19:42.107333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.107206    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-dlk52\""
Oct 30 16:19:42.107333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.107244    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 16:19:42.107333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.107249    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 16:19:42.107333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.107261    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 16:19:42.107333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.107266    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jcj7b\""
Oct 30 16:19:42.108529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108511    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.108529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108524    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 16:19:42.108529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108539    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rqh77\""
Oct 30 16:19:42.108787 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108774    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-mltnx\""
Oct 30 16:19:42.108869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108819    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7jjq4\""
Oct 30 16:19:42.108869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108826    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.108869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108831    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.108869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108832    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-njwx4\""
Oct 30 16:19:42.108869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108866    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cpfx5\""
Oct 30 16:19:42.108869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108872    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 16:19:42.108869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108878    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6x9tv\""
Oct 30 16:19:42.109156 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108868    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.109156 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108927    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-t25rz\""
Oct 30 16:19:42.109156 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.108965    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v666l\""
Oct 30 16:19:42.109567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.109550    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d8hpm\""
Oct 30 16:19:42.109567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.109564    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2ph4\""
Oct 30 16:19:42.109701 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.109567    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j7zxr\""
Oct 30 16:19:42.110082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110056    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.110201 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110180    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.110201 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110184    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sqdm6\""
Oct 30 16:19:42.110416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110396    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 16:19:42.110491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110422    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.110491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110436    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 16:19:42.110491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110473    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110491    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110505    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110514    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110474    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110541    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110547    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110563    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8qclp\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110575    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.110634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110594    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-bhx7q\""
Oct 30 16:19:42.110934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110756    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.110934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110760    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k4d4h\""
Oct 30 16:19:42.110934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110784    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 16:19:42.111016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.110953    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 16:19:42.111052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.111032    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.111306 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.111291    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 16:19:42.111792 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.111779    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 16:19:42.115076 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.115060    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.115076 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.115060    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 16:19:42.116655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.116639    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 16:19:42.116712 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.116683    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.116888 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.116877    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.117464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.117441    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-8fzhw\""
Oct 30 16:19:42.117564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.117464    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2smlp\""
Oct 30 16:19:42.117564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.117490    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.117564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.117539    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 16:19:42.117766 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.117749    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 16:19:42.117827 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.117750    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 16:19:42.117827 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.117808    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mzplq\""
Oct 30 16:19:42.118312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.118289    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 16:19:42.120910 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.120890    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-zr2xc\""
Oct 30 16:19:42.120910 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.120903    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 16:19:42.121059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.120896    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.121059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.120951    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 16:19:42.121059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.120899    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.121059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.120979    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.121059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.120991    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qnjml\""
Oct 30 16:19:42.121059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.121027    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 16:19:42.121059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.121043    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 16:19:42.121059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.121047    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.121299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.121065    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 16:19:42.121299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.121069    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 16:19:42.121299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.121110    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jr7g9\""
Oct 30 16:19:42.121299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.121113    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 16:19:42.121509 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.121495    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-snnbg\""
Oct 30 16:19:42.127022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.127006    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8_659d22c7-e8bf-48e3-a6e8-54f4e2e77cea/kube-storage-version-migrator-operator/0.log"
Oct 30 16:19:42.133237 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.133218    5101 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:42.133371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.133359    5101 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:42.137641 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.137628    5101 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 16:19:42.156759 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.156730    5101 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:19:42.156895 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.156788    5101 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-40.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:42.157587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.157573    5101 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:19:42.157661 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.157613    5101 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-40.ec2.internal"
Oct 30 16:19:42.189771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.189742    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-run\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.189939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.189776    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.189939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.189896    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f743ff-35c0-42c8-9ab1-422606471aa0-tmp-dir\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.189939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.189930    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-netns\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.190066 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.189948    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-etc-selinux\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.190066 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.189971    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-system-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.190066 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.189992    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.190066 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190032    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f743ff-35c0-42c8-9ab1-422606471aa0-tmp-dir\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.190066 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190043    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-default-certificate\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.190245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190082    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-host\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:42.190245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190112    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-systemd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.190245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190150    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.190245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190180    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:42.190245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190199    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysconfig\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.190245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190218    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwl6\" (UniqueName: \"kubernetes.io/projected/64de0045-bcde-40a0-938e-d2eeee30f20c-kube-api-access-pfwl6\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:42.190245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190240    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-default-certificate\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.190245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190245    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190274    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190290    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9s4\" (UniqueName: \"kubernetes.io/projected/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kube-api-access-rs9s4\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190307    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f1110bc-3087-4f49-9e1c-5371b8c85d09-nginx-conf\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190325    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190380    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-system-cni-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190486    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhrmz\" (UniqueName: \"kubernetes.io/projected/bf184a45-b70e-4fd6-9435-821fbeb133ba-kube-api-access-zhrmz\") pod \"kas-connection-checker-685895c7c9-s7lhf\" (UID: \"bf184a45-b70e-4fd6-9435-821fbeb133ba\") " pod="kube-system/kas-connection-checker-685895c7c9-s7lhf"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190531    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190557    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190565    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f1110bc-3087-4f49-9e1c-5371b8c85d09-nginx-conf\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190576    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-tuned\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190614    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-serviceca\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:42.190679 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190648    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-log-socket\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190693    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-socket-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190706    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-tuned\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190741    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190772    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ssmb\" (UniqueName: \"kubernetes.io/projected/3dd6c0df-eb3d-4433-839e-abdf00f47695-kube-api-access-7ssmb\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190796    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-ovn\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190906    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-cabundle\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190933    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b4h2\" (UniqueName: \"kubernetes.io/projected/72030764-3f04-44d3-97fe-3d0da005a6a2-kube-api-access-6b4h2\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190963    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.190992    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhzz\" (UniqueName: \"kubernetes.io/projected/30f743ff-35c0-42c8-9ab1-422606471aa0-kube-api-access-lmhzz\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191018    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-config\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191042    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.191206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191110    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-cabundle\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191224    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-sys-fs\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191240    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191260    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-daemon-config\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191253    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc642127-45e3-46e5-897f-93b899a68127-original-pull-secret\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191282    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191287    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-config\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191298    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-etc-kubernetes\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191327    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovn-node-metrics-cert\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191375    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-script-lib\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191415    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-serviceca\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191437    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-service-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191460    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-var-lib-kubelet\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191483    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-stats-auth\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191505    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191543    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191578    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqzz7\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191602    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-service-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191605    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-daemon-config\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191606    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191631    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovnkube-script-lib\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191639    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191709    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-stats-auth\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191740    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thd4n\" (UniqueName: \"kubernetes.io/projected/b232f810-709e-4360-9d38-3e968590bb08-kube-api-access-thd4n\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191743    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.191763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191779    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dd6c0df-eb3d-4433-839e-abdf00f47695-serving-cert\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191808    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-env-overrides\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191828    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191846    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191864    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191909    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e23d4f-4633-46b8-882f-3acabfb8a3f1-ovn-node-metrics-cert\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191913    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191947    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-kubelet\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.191973    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192013    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzqv8\" (UniqueName: \"kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192035    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192082    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192105    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dd6c0df-eb3d-4433-839e-abdf00f47695-serving-cert\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192131    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwt8q\" (UniqueName: \"kubernetes.io/projected/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-kube-api-access-mwt8q\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192137    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10e23d4f-4633-46b8-882f-3acabfb8a3f1-env-overrides\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192188    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwjz\" (UniqueName: \"kubernetes.io/projected/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-kube-api-access-cjwjz\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192223    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192254    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192280    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192304    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-serving-cert\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192331    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tr6\" (UniqueName: \"kubernetes.io/projected/10e23d4f-4633-46b8-882f-3acabfb8a3f1-kube-api-access-98tr6\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192375    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192395    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d06c87-6ddd-4605-9322-9e13e26eaaa4-tmp-dir\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192418    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d28bb413-77af-4b21-9ee8-489c521b4603-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192439    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-device-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192465    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-host\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192490    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64de0045-bcde-40a0-938e-d2eeee30f20c-cert\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192515    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192526    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d06c87-6ddd-4605-9322-9e13e26eaaa4-tmp-dir\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192539    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-tmp\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192568    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-sys\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192605    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-lib-modules\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192614    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-serving-cert\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192608    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192643    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ac16845-91f4-48c7-a02c-84fedf86171d-iptables-alerter-script\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192649    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192683    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-config\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192697    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-tmp\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192725    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192786    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64de0045-bcde-40a0-938e-d2eeee30f20c-cert\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192818    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192824    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-config\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192839    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ac16845-91f4-48c7-a02c-84fedf86171d-iptables-alerter-script\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192857    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-var-lib-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192880    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-bin\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.192908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192927    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn92z\" (UniqueName: \"kubernetes.io/projected/52e59496-41f2-430d-8c96-467b3ef3a839-kube-api-access-jn92z\") pod \"volume-data-source-validator-58c9f5f46d-gczng\" (UID: \"52e59496-41f2-430d-8c96-467b3ef3a839\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192948    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6dq\" (UniqueName: \"kubernetes.io/projected/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690-kube-api-access-sw6dq\") pod \"migrator-66df5d496b-xf9mk\" (UID: \"2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192964    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5twf\" (UniqueName: \"kubernetes.io/projected/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-kube-api-access-v5twf\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.192981    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-node-log\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193011    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193026    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-conf-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193043    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-dbus\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193091    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq84b\" (UniqueName: \"kubernetes.io/projected/17bcd7b8-e377-451f-809b-9887d5b937e2-kube-api-access-nq84b\") pod \"kas-connection-checker-685895c7c9-n4sp2\" (UID: \"17bcd7b8-e377-451f-809b-9887d5b937e2\") " pod="kube-system/kas-connection-checker-685895c7c9-n4sp2"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193201    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-tmp\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193273    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-crio-socket\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193302    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72030764-3f04-44d3-97fe-3d0da005a6a2-tmp\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193306    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2xq6\" (UniqueName: \"kubernetes.io/projected/41c538db-7de5-4e4d-ba29-d329164990cd-kube-api-access-s2xq6\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193330    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-conf\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193392    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-systemd\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193505    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7l8l\" (UniqueName: \"kubernetes.io/projected/fcb660ae-8c6a-42ec-bd90-484b9497250b-kube-api-access-f7l8l\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193535    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193558    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193576    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7qz\" (UniqueName: \"kubernetes.io/projected/5806cd90-2896-488a-ac38-10fc6d959026-kube-api-access-zw7qz\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193601    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-kubernetes\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193652    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-cnibin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193686    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193708    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-slash\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193739    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d06c87-6ddd-4605-9322-9e13e26eaaa4-hosts-file\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193768    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193807    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-bin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193827    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193841    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193843    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193861    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193880    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-hostroot\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193903    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/41c538db-7de5-4e4d-ba29-d329164990cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193920    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-etc-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193942    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-cnibin\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.193984    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-snapshots\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194110    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8hr4\" (UniqueName: \"kubernetes.io/projected/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-api-access-d8hr4\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194132    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d28bb413-77af-4b21-9ee8-489c521b4603-snapshots\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194134    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/41c538db-7de5-4e4d-ba29-d329164990cd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194138    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgt5l\" (UniqueName: \"kubernetes.io/projected/8ac16845-91f4-48c7-a02c-84fedf86171d-kube-api-access-rgt5l\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:42.194234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194218    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194252    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194302    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5zt\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194332    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqcch\" (UniqueName: \"kubernetes.io/projected/37d06c87-6ddd-4605-9322-9e13e26eaaa4-kube-api-access-sqcch\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194367    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194375    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz7cw\" (UniqueName: \"kubernetes.io/projected/c6f74c24-d57d-4296-b70d-631bd8eac394-kube-api-access-zz7cw\") pod \"kas-connection-checker-685895c7c9-95hdf\" (UID: \"c6f74c24-d57d-4296-b70d-631bd8eac394\") " pod="kube-system/kas-connection-checker-685895c7c9-95hdf"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194400    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-cni-binary-copy\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194430    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194458    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf99n\" (UniqueName: \"kubernetes.io/projected/ee06d536-e9ad-4690-87e1-3a82db673caa-kube-api-access-zf99n\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194484    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-modprobe-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194587    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-data-volume\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194667    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5b373b2-2951-49d8-98a5-221c47b724c0-cni-binary-copy\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194636    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-multus-certs\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194704    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194705    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-data-volume\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194723    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dd6c0df-eb3d-4433-839e-abdf00f47695-config\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194831    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dd6c0df-eb3d-4433-839e-abdf00f47695-config\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194852    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194876    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d28bb413-77af-4b21-9ee8-489c521b4603-serving-cert\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194894    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-netns\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194910    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-kubelet\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.194941    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7q2d\" (UniqueName: \"kubernetes.io/projected/e5b373b2-2951-49d8-98a5-221c47b724c0-kube-api-access-x7q2d\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195052    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195069    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-socket-dir-parent\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195088    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-k8s-cni-cncf-io\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195105    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hftk2\" (UniqueName: \"kubernetes.io/projected/a64c6e47-3cf0-4453-b3e6-2657a66813e8-kube-api-access-hftk2\") pod \"network-check-source-6f78d59f99-8bw88\" (UID: \"a64c6e47-3cf0-4453-b3e6-2657a66813e8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195129    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnd4f\" (UniqueName: \"kubernetes.io/projected/88847d7c-8749-4920-9c90-97f93bbfc432-kube-api-access-fnd4f\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195259    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195270    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ac16845-91f4-48c7-a02c-84fedf86171d-host-slash\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195316    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-kubelet-config\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195369    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30f743ff-35c0-42c8-9ab1-422606471aa0-config-volume\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195389    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-systemd-units\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195417    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d28bb413-77af-4b21-9ee8-489c521b4603-serving-cert\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195426    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195445    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-registration-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195488    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195514    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30f743ff-35c0-42c8-9ab1-422606471aa0-config-volume\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195519    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195549    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-netd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195575    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195605    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p56j6\" (UniqueName: \"kubernetes.io/projected/d28bb413-77af-4b21-9ee8-489c521b4603-kube-api-access-p56j6\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195645    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-multus\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195681    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-konnectivity-ca\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195696    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195713    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9bm\" (UniqueName: \"kubernetes.io/projected/22bd7f2a-ce4d-4888-a8bb-521657c81151-kube-api-access-7v9bm\") pod \"migrator-66df5d496b-txhn7\" (UID: \"22bd7f2a-ce4d-4888-a8bb-521657c81151\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195757    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-trusted-ca\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195786    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195813    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-agent-certs\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195821    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5806cd90-2896-488a-ac38-10fc6d959026-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195842    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195859    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-konnectivity-ca\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:42.195854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195868    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-key\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:42.197329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.195971    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.197329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.196039    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-trusted-ca\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.197329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.196128    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749-agent-certs\") pod \"konnectivity-agent-bvzgm\" (UID: \"dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749\") " pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:42.197329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.196180    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee06d536-e9ad-4690-87e1-3a82db673caa-signing-key\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:42.217556 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.217509    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwl6\" (UniqueName: \"kubernetes.io/projected/64de0045-bcde-40a0-938e-d2eeee30f20c-kube-api-access-pfwl6\") pod \"ingress-canary-rbczx\" (UID: \"64de0045-bcde-40a0-938e-d2eeee30f20c\") " pod="openshift-ingress-canary/ingress-canary-rbczx"
Oct 30 16:19:42.217947 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.217925    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhrmz\" (UniqueName: \"kubernetes.io/projected/bf184a45-b70e-4fd6-9435-821fbeb133ba-kube-api-access-zhrmz\") pod \"kas-connection-checker-685895c7c9-s7lhf\" (UID: \"bf184a45-b70e-4fd6-9435-821fbeb133ba\") " pod="kube-system/kas-connection-checker-685895c7c9-s7lhf"
Oct 30 16:19:42.218048 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.218032    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b4h2\" (UniqueName: \"kubernetes.io/projected/72030764-3f04-44d3-97fe-3d0da005a6a2-kube-api-access-6b4h2\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.218203 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.218181    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thd4n\" (UniqueName: \"kubernetes.io/projected/b232f810-709e-4360-9d38-3e968590bb08-kube-api-access-thd4n\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:42.218283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.218184    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhzz\" (UniqueName: \"kubernetes.io/projected/30f743ff-35c0-42c8-9ab1-422606471aa0-kube-api-access-lmhzz\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.218283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.218234    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzqv8\" (UniqueName: \"kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8\") pod \"periodic-gathering-b82vr-4mwk6\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") " pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:19:42.218644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.218626    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqzz7\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.218703 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.218652    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ssmb\" (UniqueName: \"kubernetes.io/projected/3dd6c0df-eb3d-4433-839e-abdf00f47695-kube-api-access-7ssmb\") pod \"service-ca-operator-544d749c8c-nnhzw\" (UID: \"3dd6c0df-eb3d-4433-839e-abdf00f47695\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw"
Oct 30 16:19:42.218742 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.218713    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9s4\" (UniqueName: \"kubernetes.io/projected/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kube-api-access-rs9s4\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.219467 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.219452    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56j6\" (UniqueName: \"kubernetes.io/projected/d28bb413-77af-4b21-9ee8-489c521b4603-kube-api-access-p56j6\") pod \"insights-operator-7c4986d449-zfp2k\" (UID: \"d28bb413-77af-4b21-9ee8-489c521b4603\") " pod="openshift-insights/insights-operator-7c4986d449-zfp2k"
Oct 30 16:19:42.220241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.220225    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqcch\" (UniqueName: \"kubernetes.io/projected/37d06c87-6ddd-4605-9322-9e13e26eaaa4-kube-api-access-sqcch\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:42.221295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.221277    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwzmt\" (UniqueName: \"kubernetes.io/projected/7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36-kube-api-access-lwzmt\") pod \"network-check-target-7c4px\" (UID: \"7e5d808e-a4ea-455f-9ea9-6e0a2f14ec36\") " pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:42.222707 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.222691    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5twf\" (UniqueName: \"kubernetes.io/projected/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-kube-api-access-v5twf\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:42.223034 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.222996    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6dq\" (UniqueName: \"kubernetes.io/projected/2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690-kube-api-access-sw6dq\") pod \"migrator-66df5d496b-xf9mk\" (UID: \"2b0297c4-9de9-4bba-b1f4-eaf3ff2e8690\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xf9mk"
Oct 30 16:19:42.223225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.223205    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwt8q\" (UniqueName: \"kubernetes.io/projected/659d22c7-e8bf-48e3-a6e8-54f4e2e77cea-kube-api-access-mwt8q\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8\" (UID: \"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8"
Oct 30 16:19:42.223364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.223254    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9bm\" (UniqueName: \"kubernetes.io/projected/22bd7f2a-ce4d-4888-a8bb-521657c81151-kube-api-access-7v9bm\") pod \"migrator-66df5d496b-txhn7\" (UID: \"22bd7f2a-ce4d-4888-a8bb-521657c81151\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-txhn7"
Oct 30 16:19:42.223364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.223287    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq84b\" (UniqueName: \"kubernetes.io/projected/17bcd7b8-e377-451f-809b-9887d5b937e2-kube-api-access-nq84b\") pod \"kas-connection-checker-685895c7c9-n4sp2\" (UID: \"17bcd7b8-e377-451f-809b-9887d5b937e2\") " pod="kube-system/kas-connection-checker-685895c7c9-n4sp2"
Oct 30 16:19:42.223478 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.223464    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t5zt\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.223606 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.223584    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz7cw\" (UniqueName: \"kubernetes.io/projected/c6f74c24-d57d-4296-b70d-631bd8eac394-kube-api-access-zz7cw\") pod \"kas-connection-checker-685895c7c9-95hdf\" (UID: \"c6f74c24-d57d-4296-b70d-631bd8eac394\") " pod="kube-system/kas-connection-checker-685895c7c9-95hdf"
Oct 30 16:19:42.223796 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.223778    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwjz\" (UniqueName: \"kubernetes.io/projected/d5b9aacd-cd48-4496-a43a-ce89ff7a29fa-kube-api-access-cjwjz\") pod \"console-operator-7cd56b8dbc-ml6q4\" (UID: \"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.224090 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.224074    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8hr4\" (UniqueName: \"kubernetes.io/projected/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-api-access-d8hr4\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.224369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.224334    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn92z\" (UniqueName: \"kubernetes.io/projected/52e59496-41f2-430d-8c96-467b3ef3a839-kube-api-access-jn92z\") pod \"volume-data-source-validator-58c9f5f46d-gczng\" (UID: \"52e59496-41f2-430d-8c96-467b3ef3a839\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gczng"
Oct 30 16:19:42.224688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.224625    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgt5l\" (UniqueName: \"kubernetes.io/projected/8ac16845-91f4-48c7-a02c-84fedf86171d-kube-api-access-rgt5l\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:42.224823 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.224803    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2xq6\" (UniqueName: \"kubernetes.io/projected/41c538db-7de5-4e4d-ba29-d329164990cd-kube-api-access-s2xq6\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.225045 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.225026    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hftk2\" (UniqueName: \"kubernetes.io/projected/a64c6e47-3cf0-4453-b3e6-2657a66813e8-kube-api-access-hftk2\") pod \"network-check-source-6f78d59f99-8bw88\" (UID: \"a64c6e47-3cf0-4453-b3e6-2657a66813e8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-8bw88"
Oct 30 16:19:42.225512 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.225494    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tr6\" (UniqueName: \"kubernetes.io/projected/10e23d4f-4633-46b8-882f-3acabfb8a3f1-kube-api-access-98tr6\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.225560 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.225494    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7q2d\" (UniqueName: \"kubernetes.io/projected/e5b373b2-2951-49d8-98a5-221c47b724c0-kube-api-access-x7q2d\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.226388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.226372    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnd4f\" (UniqueName: \"kubernetes.io/projected/88847d7c-8749-4920-9c90-97f93bbfc432-kube-api-access-fnd4f\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:42.227959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.227943    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf99n\" (UniqueName: \"kubernetes.io/projected/ee06d536-e9ad-4690-87e1-3a82db673caa-kube-api-access-zf99n\") pod \"service-ca-5fffc97bdf-nvmr7\" (UID: \"ee06d536-e9ad-4690-87e1-3a82db673caa\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nvmr7"
Oct 30 16:19:42.228930 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.228896    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7qz\" (UniqueName: \"kubernetes.io/projected/5806cd90-2896-488a-ac38-10fc6d959026-kube-api-access-zw7qz\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.229043 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.229022    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.229104 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.229041    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.229559 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.229540    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7l8l\" (UniqueName: \"kubernetes.io/projected/fcb660ae-8c6a-42ec-bd90-484b9497250b-kube-api-access-f7l8l\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.296905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.296827    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.296905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.296870    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-ovn\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.296905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.296893    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-sys-fs\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.296926    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-etc-kubernetes\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.296947    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-var-lib-kubelet\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.296955    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-ovn\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.296967    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297005    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297009    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-etc-kubernetes\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297026    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297031    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297060    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-kubelet\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297076    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-sys-fs\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297089    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.297129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297116    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.297156    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:42.797137649 +0000 UTC m=+1.850415237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297178    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-device-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297201    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-host\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297223    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297063    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-var-lib-kubelet\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297272    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-sys\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297329    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-sys\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297220    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-kubelet\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.297361    5101 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297382    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-lib-modules\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297419    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-var-lib-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.297429    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:42.797414105 +0000 UTC m=+1.850691694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.297454    5101 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297461    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-bin\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297489    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-node-log\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297502    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-device-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297507    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-lib-modules\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297497    5101 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.297537    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:42.797516656 +0000 UTC m=+1.850796674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : secret "router-metrics-certs-default" not found
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297457    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-var-lib-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297551    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-conf-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297559    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-bin\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297559    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-host\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297513    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-conf-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297596    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-dbus\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297612    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-node-log\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297665    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-dbus\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:42.297671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297664    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-crio-socket\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297705    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-conf\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297709    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-crio-socket\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297723    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-systemd\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297750    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-kubernetes\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297775    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-cnibin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297783    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-systemd\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297798    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297840    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-conf\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297844    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-slash\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297860    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-kubernetes\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297870    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d06c87-6ddd-4605-9322-9e13e26eaaa4-hosts-file\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297877    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-cnibin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297895    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-bin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297914    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-slash\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297920    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297936    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37d06c87-6ddd-4605-9322-9e13e26eaaa4-hosts-file\") pod \"node-resolver-k4b9s\" (UID: \"37d06c87-6ddd-4605-9322-9e13e26eaaa4\") " pod="openshift-dns/node-resolver-k4b9s"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297954    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-bin\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297946    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297990    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.297983    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-hostroot\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.298023    5101 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298027    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-hostroot\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298033    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-etc-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298059    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-cnibin\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.298075    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:42.798065983 +0000 UTC m=+1.851343573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298090    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-cnibin\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298107    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298130    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-etc-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298152    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-modprobe-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298180    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-multus-certs\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298214    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298242    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-netns\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298252    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-multus-certs\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298258    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-modprobe-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298264    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-kubelet\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298300    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-netns\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298311    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-socket-dir-parent\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298320    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298351    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-k8s-cni-cncf-io\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298380    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ac16845-91f4-48c7-a02c-84fedf86171d-host-slash\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298382    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-kubelet\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298399    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-multus-socket-dir-parent\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298412    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-run-k8s-cni-cncf-io\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298417    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-kubelet-config\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298457    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc642127-45e3-46e5-897f-93b899a68127-kubelet-config\") pod \"global-pull-secret-syncer-4xnzd\" (UID: \"fc642127-45e3-46e5-897f-93b899a68127\") " pod="kube-system/global-pull-secret-syncer-4xnzd"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298467    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysctl-d\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298427    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ac16845-91f4-48c7-a02c-84fedf86171d-host-slash\") pod \"iptables-alerter-xl9bk\" (UID: \"8ac16845-91f4-48c7-a02c-84fedf86171d\") " pod="openshift-network-operator/iptables-alerter-xl9bk"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298485    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-systemd-units\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298527    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298522    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-systemd-units\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298555    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-registration-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298578    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298580    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-netd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298618    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-cni-netd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298619    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-multus\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298650    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-host-var-lib-cni-multus\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298663    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298666    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-registration-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298694    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-run\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298726    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-netns\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298824    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-etc-selinux\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298851    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-system-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298878    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-host\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298902    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-systemd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298929    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298933    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-etc-selinux\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298787    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-run\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298958    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299005    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-systemd\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299012    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysconfig\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299046    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299067    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-run-openvswitch\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299077    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-system-cni-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299104    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299124    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd-host\") pod \"node-ca-9s5vn\" (UID: \"88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd\") " pod="openshift-image-registry/node-ca-9s5vn"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299129    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-log-socket\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.299122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299165    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-socket-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299299    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-socket-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299318    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcd8fb6-aaea-456a-bf39-c58f04323aee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tx2p8\" (UID: \"5dcd8fb6-aaea-456a-bf39-c58f04323aee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tx2p8"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.298743    5101 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.299496    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72030764-3f04-44d3-97fe-3d0da005a6a2-etc-sysconfig\") pod \"tuned-82qt4\" (UID: \"72030764-3f04-44d3-97fe-3d0da005a6a2\") " pod="openshift-cluster-node-tuning-operator/tuned-82qt4"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.298790    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-host-run-netns\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.300153    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5b373b2-2951-49d8-98a5-221c47b724c0-system-cni-dir\") pod \"multus-2clff\" (UID: \"e5b373b2-2951-49d8-98a5-221c47b724c0\") " pod="openshift-multus/multus-2clff"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.300951    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"image-registry-7869764d77-758qx\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") " pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.301492    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"image-registry-768cfdff76-wxc2q\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") " pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.301623    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30f743ff-35c0-42c8-9ab1-422606471aa0-metrics-tls\") pod \"dns-default-l8nf9\" (UID: \"30f743ff-35c0-42c8-9ab1-422606471aa0\") " pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.301637    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:42.801619344 +0000 UTC m=+1.854896947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.301672    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e23d4f-4633-46b8-882f-3acabfb8a3f1-log-socket\") pod \"ovnkube-node-jxtgs\" (UID: \"10e23d4f-4633-46b8-882f-3acabfb8a3f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.301706    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5806cd90-2896-488a-ac38-10fc6d959026-system-cni-dir\") pod \"multus-additional-cni-plugins-dlcgr\" (UID: \"5806cd90-2896-488a-ac38-10fc6d959026\") " pod="openshift-multus/multus-additional-cni-plugins-dlcgr"
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.301722    5101 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 16:19:42.303060 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.301784    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs podName:88847d7c-8749-4920-9c90-97f93bbfc432 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:42.801761059 +0000 UTC m=+1.855038665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs") pod "network-metrics-daemon-rttw4" (UID: "88847d7c-8749-4920-9c90-97f93bbfc432") : secret "metrics-daemon-secret" not found
Oct 30 16:19:42.307397 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.307377    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f1110bc-3087-4f49-9e1c-5371b8c85d09-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-kjxhd\" (UID: \"9f1110bc-3087-4f49-9e1c-5371b8c85d09\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:42.307495 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.307420    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/41c538db-7de5-4e4d-ba29-d329164990cd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5knxh\" (UID: \"41c538db-7de5-4e4d-ba29-d329164990cd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.330623 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.330548    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:42.382388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.382361    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:42.383490 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.383469    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"
Oct 30 16:19:42.384546 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.384524    5101 scope.go:122] "RemoveContainer" containerID="1f13a1bbb1950524457cdc79dcdd92cef71cec9bdd41f7949640c3c77e41c508"
Oct 30 16:19:42.384834 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.384815    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"
Oct 30 16:19:42.395972 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.395955    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:42.396036 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.396002    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:42.459482 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.459457    5101 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:42.723763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.723740    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768cfdff76-wxc2q"]
Oct 30 16:19:42.743255 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.743207    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:42.764586 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.764562    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh"]
Oct 30 16:19:42.770417 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:42.770387    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c538db_7de5_4e4d_ba29_d329164990cd.slice/crio-068278aede59261a0f688e5d42a8888494d1023e62e61ec3724619e2270fdc70 WatchSource:0}: Error finding container 068278aede59261a0f688e5d42a8888494d1023e62e61ec3724619e2270fdc70: Status 404 returned error can't find the container with id 068278aede59261a0f688e5d42a8888494d1023e62e61ec3724619e2270fdc70
Oct 30 16:19:42.775250 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.775221    5101 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:19:42.797273 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.797212    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7869764d77-758qx"]
Oct 30 16:19:42.799627 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:42.799604    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafdf3517_540a_470f_b111_043df8f007c5.slice/crio-96df6776598c9c7cc67bff37b91e5b49c97ec3c33b16513c2940aec9c95de350 WatchSource:0}: Error finding container 96df6776598c9c7cc67bff37b91e5b49c97ec3c33b16513c2940aec9c95de350: Status 404 returned error can't find the container with id 96df6776598c9c7cc67bff37b91e5b49c97ec3c33b16513c2940aec9c95de350
Oct 30 16:19:42.802469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.802444    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.802572 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.802492    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.802572 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.802533    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:42.802664 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.802580    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:42.802664 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802599    5101 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:42.802664 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802600    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:43.80258395 +0000 UTC m=+2.855861566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:42.802664 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802636    5101 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:42.802820 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802676    5101 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 16:19:42.802820 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802678    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:43.802663272 +0000 UTC m=+2.855940861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:42.802820 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802740    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:43.802725772 +0000 UTC m=+2.856003364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:42.802820 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802757    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:43.802747868 +0000 UTC m=+2.856025461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : secret "router-metrics-certs-default" not found
Oct 30 16:19:42.802820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.802802    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:42.803013 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.802846    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:42.803013 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802866    5101 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:42.803013 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:42.802908    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:43.802895847 +0000 UTC m=+2.856173474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:42.804959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.804942    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88847d7c-8749-4920-9c90-97f93bbfc432-metrics-certs\") pod \"network-metrics-daemon-rttw4\" (UID: \"88847d7c-8749-4920-9c90-97f93bbfc432\") " pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:42.824122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.824098    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-kjxhd"]
Oct 30 16:19:42.826192 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:42.826171    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1110bc_3087_4f49_9e1c_5371b8c85d09.slice/crio-30fce13d823b71ba50354e8860f1023d01daf1290e63858be49e0fd05220dd14 WatchSource:0}: Error finding container 30fce13d823b71ba50354e8860f1023d01daf1290e63858be49e0fd05220dd14: Status 404 returned error can't find the container with id 30fce13d823b71ba50354e8860f1023d01daf1290e63858be49e0fd05220dd14
Oct 30 16:19:42.851626 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.851604    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l8nf9"]
Oct 30 16:19:42.853101 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:42.853081    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f743ff_35c0_42c8_9ab1_422606471aa0.slice/crio-eefb2bed204c30ac8a33725605420a3b4faa37e7eb10580f76b12111f16548e9 WatchSource:0}: Error finding container eefb2bed204c30ac8a33725605420a3b4faa37e7eb10580f76b12111f16548e9: Status 404 returned error can't find the container with id eefb2bed204c30ac8a33725605420a3b4faa37e7eb10580f76b12111f16548e9
Oct 30 16:19:42.936941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.936904    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:42.985935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:42.985900    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rttw4"
Oct 30 16:19:43.140374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.139783    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q" event={"ID":"4b6aeef2-7878-466d-964c-2a375bdb8f04","Type":"ContainerStarted","Data":"bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef"}
Oct 30 16:19:43.140374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.139843    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q" event={"ID":"4b6aeef2-7878-466d-964c-2a375bdb8f04","Type":"ContainerStarted","Data":"bb6810e74c1b3b4a57612ec199eb611f8926dd20dbd4617bf0c3de3d20e4d505"}
Oct 30 16:19:43.145564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.145538    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:19:43.145721 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.145643    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4" event={"ID":"d5b9aacd-cd48-4496-a43a-ce89ff7a29fa","Type":"ContainerStarted","Data":"d8f61f5019b09c36fdedb2fe9e049640a3efda0a6deabf585692cc8e5ba7d0b4"}
Oct 30 16:19:43.147176 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.147146    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8nf9" event={"ID":"30f743ff-35c0-42c8-9ab1-422606471aa0","Type":"ContainerStarted","Data":"eefb2bed204c30ac8a33725605420a3b4faa37e7eb10580f76b12111f16548e9"}
Oct 30 16:19:43.148552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.148525    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd" event={"ID":"9f1110bc-3087-4f49-9e1c-5371b8c85d09","Type":"ContainerStarted","Data":"30fce13d823b71ba50354e8860f1023d01daf1290e63858be49e0fd05220dd14"}
Oct 30 16:19:43.150295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.150267    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869764d77-758qx" event={"ID":"afdf3517-540a-470f-b111-043df8f007c5","Type":"ContainerStarted","Data":"5d710c5cc6525f4c5556b9eae0be8d70551b1bba260a9a3b4012c6975dd441c5"}
Oct 30 16:19:43.150401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.150318    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869764d77-758qx" event={"ID":"afdf3517-540a-470f-b111-043df8f007c5","Type":"ContainerStarted","Data":"96df6776598c9c7cc67bff37b91e5b49c97ec3c33b16513c2940aec9c95de350"}
Oct 30 16:19:43.151616 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.151589    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh" event={"ID":"41c538db-7de5-4e4d-ba29-d329164990cd","Type":"ContainerStarted","Data":"068278aede59261a0f688e5d42a8888494d1023e62e61ec3724619e2270fdc70"}
Oct 30 16:19:43.213406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.213357    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:43.301834 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.301809    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rttw4"]
Oct 30 16:19:43.303684 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:43.303656    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88847d7c_8749_4920_9c90_97f93bbfc432.slice/crio-d993327ebab4924985226d62172fbc7a5a3dd76cf3392cc398488d811b150fc7 WatchSource:0}: Error finding container d993327ebab4924985226d62172fbc7a5a3dd76cf3392cc398488d811b150fc7: Status 404 returned error can't find the container with id d993327ebab4924985226d62172fbc7a5a3dd76cf3392cc398488d811b150fc7
Oct 30 16:19:43.353716 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.353683    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:43.498364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.498308    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:43.647594 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.647558    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:43.813988 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.813941    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:43.814166 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.814027    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:43.814166 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.814071    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:43.814166 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.814107    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:43.814166 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:43.814122    5101 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:43.814166 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.814159    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:43.814496 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:43.814183    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.814160503 +0000 UTC m=+4.867438106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:43.814496 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:43.814223    5101 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:43.814496 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:43.814226    5101 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:43.814496 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:43.814276    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.814258627 +0000 UTC m=+4.867536230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:43.814496 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:43.814297    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.814287079 +0000 UTC m=+4.867564671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:43.814496 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:43.814318    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:45.814308749 +0000 UTC m=+4.867586344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:43.817557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:43.817528    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcb660ae-8c6a-42ec-bd90-484b9497250b-metrics-certs\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:44.121063 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.120981    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:44.160385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.158959    5101 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:44.160385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.159569    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rttw4" event={"ID":"88847d7c-8749-4920-9c90-97f93bbfc432","Type":"ContainerStarted","Data":"d993327ebab4924985226d62172fbc7a5a3dd76cf3392cc398488d811b150fc7"}
Oct 30 16:19:44.160385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.159643    5101 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:44.160385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.160006    5101 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:44.257555 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.257529    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bvzgm"
Oct 30 16:19:44.328027 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.327983    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:44.481377 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.481287    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:44.609238 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.609192    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:44.615418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.615395    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-ml6q4"
Oct 30 16:19:44.739683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.739664    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:44.884126 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:44.884091    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:45.039450 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.039368    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:45.163876 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.163834    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-kjxhd" event={"ID":"9f1110bc-3087-4f49-9e1c-5371b8c85d09","Type":"ContainerStarted","Data":"fa40d99726987a711324e07620a3f29853c8be41334e53e88e68439cbe16298f"}
Oct 30 16:19:45.165554 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.165528    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rttw4" event={"ID":"88847d7c-8749-4920-9c90-97f93bbfc432","Type":"ContainerStarted","Data":"e4184c2ea9f6d5623032d20c69539929f4a9d54e86aa0951b819745bd93b5262"}
Oct 30 16:19:45.165692 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.165569    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rttw4" event={"ID":"88847d7c-8749-4920-9c90-97f93bbfc432","Type":"ContainerStarted","Data":"02a9ce19251a78d9a96615677584f672f675a6109abfc6385bf48ef719521fc9"}
Oct 30 16:19:45.312175 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.312104    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:45.784279 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.784244    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:19:45.796577 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.796545    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:45.835606 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.835575    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:45.835779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.835634    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:45.835779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.835668    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:45.835779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.835718    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:45.835779 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:45.835734    5101 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 16:19:45.836291 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:45.835800    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls podName:b232f810-709e-4360-9d38-3e968590bb08 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:49.835783348 +0000 UTC m=+8.889060956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-ps7kc" (UID: "b232f810-709e-4360-9d38-3e968590bb08") : secret "samples-operator-tls" not found
Oct 30 16:19:45.836291 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:45.835806    5101 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:45.836291 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:45.835807    5101 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:45.836291 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:45.835833    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle podName:fcb660ae-8c6a-42ec-bd90-484b9497250b nodeName:}" failed. No retries permitted until 2026-10-30 16:19:49.835811542 +0000 UTC m=+8.889089145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle") pod "router-default-9f769b7d5-g6vn9" (UID: "fcb660ae-8c6a-42ec-bd90-484b9497250b") : configmap references non-existent config key: service-ca.crt
Oct 30 16:19:45.836291 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:45.835864    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:49.835853315 +0000 UTC m=+8.889130910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:45.836291 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:45.835880    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:49.835871076 +0000 UTC m=+8.889148667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:45.946058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:45.946017    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:46.119657 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.119573    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:46.170949 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.170916    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5knxh" event={"ID":"41c538db-7de5-4e4d-ba29-d329164990cd","Type":"ContainerStarted","Data":"f214068b9552db0530efb4b9881df63b5d4d2d45a5474747f8610d1726ab5618"}
Oct 30 16:19:46.172519 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.172494    5101 generic.go:356] "Generic (PLEG): container finished" podID="d28bb413-77af-4b21-9ee8-489c521b4603" containerID="d1b5614baa867b7b12f485ebf7cef0acc24986cff21aee48ec2cc1075cf5af96" exitCode=0
Oct 30 16:19:46.172620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.172565    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-zfp2k" event={"ID":"d28bb413-77af-4b21-9ee8-489c521b4603","Type":"ContainerDied","Data":"d1b5614baa867b7b12f485ebf7cef0acc24986cff21aee48ec2cc1075cf5af96"}
Oct 30 16:19:46.172859 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.172843    5101 scope.go:122] "RemoveContainer" containerID="d1b5614baa867b7b12f485ebf7cef0acc24986cff21aee48ec2cc1075cf5af96"
Oct 30 16:19:46.174559 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.174531    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8nf9" event={"ID":"30f743ff-35c0-42c8-9ab1-422606471aa0","Type":"ContainerStarted","Data":"b117699568ba2bdd9132531455b2db88576e5626ef0cb8c21ae30f3edc0e6bcf"}
Oct 30 16:19:46.174642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.174580    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8nf9" event={"ID":"30f743ff-35c0-42c8-9ab1-422606471aa0","Type":"ContainerStarted","Data":"51d566c6f255b8f26d6007a4f3cacbb108d22262d6e3b08eaa4410c0d336641a"}
Oct 30 16:19:46.265095 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.265040    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:46.518430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.518396    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:46.562531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.562504    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:46.723614 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.723581    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:46.743585 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.743553    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:19:46.907315 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:46.907283    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:47.144847 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:47.144817    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:47.179547 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:47.179466    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-zfp2k" event={"ID":"d28bb413-77af-4b21-9ee8-489c521b4603","Type":"ContainerStarted","Data":"f13b44d6d4657859c790392710da705ef1733cd298aaaaac51e6370af5a8b495"}
Oct 30 16:19:47.180896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:47.180873    5101 generic.go:356] "Generic (PLEG): container finished" podID="3dd6c0df-eb3d-4433-839e-abdf00f47695" containerID="145f310b3beff9a211411e9a8036485dbd583ab0118159042b07acedb9637826" exitCode=0
Oct 30 16:19:47.181027 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:47.180955    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw" event={"ID":"3dd6c0df-eb3d-4433-839e-abdf00f47695","Type":"ContainerDied","Data":"145f310b3beff9a211411e9a8036485dbd583ab0118159042b07acedb9637826"}
Oct 30 16:19:47.181247 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:47.181230    5101 scope.go:122] "RemoveContainer" containerID="145f310b3beff9a211411e9a8036485dbd583ab0118159042b07acedb9637826"
Oct 30 16:19:47.181322 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:47.181281    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:47.181491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:47.181476    5101 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:47.317180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:47.317148    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:48.116570 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:48.116534    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:48.187209 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:48.187174    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-nnhzw" event={"ID":"3dd6c0df-eb3d-4433-839e-abdf00f47695","Type":"ContainerStarted","Data":"e8d2319841e31852890db52ada53e41d4d7d9073179ef8232d37dc520a74a82b"}
Oct 30 16:19:48.289268 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:48.289234    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:19:48.521750 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:48.521719    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:48.717251 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:48.717218    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:48.918975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:48.918945    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:49.115352 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.115303    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:49.341152 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.341077    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:49.874942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.874910    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:49.875110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.874960    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:49.875110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.874984    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:49.875110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.875016    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:49.875110 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:49.875088    5101 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 16:19:49.875261 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:49.875149    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:57.875132843 +0000 UTC m=+16.928410433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : configmap "kube-rbac-proxy" not found
Oct 30 16:19:49.875261 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:49.875150    5101 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:49.875377 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:49.875263    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls podName:0a402821-d2bd-4ebe-a4cb-897a5b3f4625 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:57.875243498 +0000 UTC m=+16.928521106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wkcqh" (UID: "0a402821-d2bd-4ebe-a4cb-897a5b3f4625") : secret "insights-runtime-extractor-tls" not found
Oct 30 16:19:49.875629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.875613    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb660ae-8c6a-42ec-bd90-484b9497250b-service-ca-bundle\") pod \"router-default-9f769b7d5-g6vn9\" (UID: \"fcb660ae-8c6a-42ec-bd90-484b9497250b\") " pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:49.877319 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.877301    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b232f810-709e-4360-9d38-3e968590bb08-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-ps7kc\" (UID: \"b232f810-709e-4360-9d38-3e968590bb08\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:49.882206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.882189    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:49.883258 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:49.883239    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"
Oct 30 16:19:50.126494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:50.126414    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:50.208686 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:50.208659    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc"]
Oct 30 16:19:50.216509 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:50.216483    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb660ae_8c6a_42ec_bd90_484b9497250b.slice/crio-8c438dbd72f0b1a3c8e1dbddc349dc14208361ad930544a0f72940edcf4e78b4 WatchSource:0}: Error finding container 8c438dbd72f0b1a3c8e1dbddc349dc14208361ad930544a0f72940edcf4e78b4: Status 404 returned error can't find the container with id 8c438dbd72f0b1a3c8e1dbddc349dc14208361ad930544a0f72940edcf4e78b4
Oct 30 16:19:50.220653 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:50.220592    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9f769b7d5-g6vn9"]
Oct 30 16:19:50.321583 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:50.321546    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:50.468797 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:50.468763    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:50.610657 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:50.610626    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:50.759288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:50.759165    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:50.911320 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:50.911286    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:51.109950 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:51.109873    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:51.199935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:51.199899    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc" event={"ID":"b232f810-709e-4360-9d38-3e968590bb08","Type":"ContainerStarted","Data":"13f2dcc3aaa14fa42c3ed6e3005285234b4d254bb016258fc82a6c6d63558705"}
Oct 30 16:19:51.201587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:51.201558    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9f769b7d5-g6vn9" event={"ID":"fcb660ae-8c6a-42ec-bd90-484b9497250b","Type":"ContainerStarted","Data":"3e69a12832819c28311565ca745aefe666c541b551f8a2c00f1b7b43bba7a7d2"}
Oct 30 16:19:51.201725 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:51.201608    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9f769b7d5-g6vn9" event={"ID":"fcb660ae-8c6a-42ec-bd90-484b9497250b","Type":"ContainerStarted","Data":"8c438dbd72f0b1a3c8e1dbddc349dc14208361ad930544a0f72940edcf4e78b4"}
Oct 30 16:19:51.883075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:51.883044    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:51.885316 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:51.885293    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:52.207063 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.207031    5101 generic.go:356] "Generic (PLEG): container finished" podID="d28bb413-77af-4b21-9ee8-489c521b4603" containerID="f13b44d6d4657859c790392710da705ef1733cd298aaaaac51e6370af5a8b495" exitCode=0
Oct 30 16:19:52.207239 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.207102    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-zfp2k" event={"ID":"d28bb413-77af-4b21-9ee8-489c521b4603","Type":"ContainerDied","Data":"f13b44d6d4657859c790392710da705ef1733cd298aaaaac51e6370af5a8b495"}
Oct 30 16:19:52.207239 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.207155    5101 scope.go:122] "RemoveContainer" containerID="d1b5614baa867b7b12f485ebf7cef0acc24986cff21aee48ec2cc1075cf5af96"
Oct 30 16:19:52.207530 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.207509    5101 scope.go:122] "RemoveContainer" containerID="f13b44d6d4657859c790392710da705ef1733cd298aaaaac51e6370af5a8b495"
Oct 30 16:19:52.207758 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:19:52.207735    5101 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"insights-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=insights-operator pod=insights-operator-7c4986d449-zfp2k_openshift-insights(d28bb413-77af-4b21-9ee8-489c521b4603)\"" pod="openshift-insights/insights-operator-7c4986d449-zfp2k" podUID="d28bb413-77af-4b21-9ee8-489c521b4603"
Oct 30 16:19:52.209099 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.209076    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc" event={"ID":"b232f810-709e-4360-9d38-3e968590bb08","Type":"ContainerStarted","Data":"1da0413d5042406b5aaa0beb0d38af57eb6b0431117c4317453761bbcd8c7646"}
Oct 30 16:19:52.209392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.209369    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:52.209491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.209408    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-ps7kc" event={"ID":"b232f810-709e-4360-9d38-3e968590bb08","Type":"ContainerStarted","Data":"3ba68346a4d162b8288664ff96607459fe444cd878c31bc141edccaba2a12de6"}
Oct 30 16:19:52.210360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.210330    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9f769b7d5-g6vn9"
Oct 30 16:19:52.238381 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:52.238359    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxtgs"
Oct 30 16:19:53.627649 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:53.627613    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:53.779964 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:53.779930    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:54.332051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:54.332004    5101 patch_prober.go:29] interesting pod/image-registry-768cfdff76-wxc2q container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 16:19:54.332221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:54.332071    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q" podUID="4b6aeef2-7878-466d-964c-2a375bdb8f04" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:19:56.954726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:56.954693    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-vfqbl-kcwh5"]
Oct 30 16:19:56.957880 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:56.957830    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:56.987260 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:56.987219    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-9rfh6"]
Oct 30 16:19:56.995533 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:56.995503    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:19:56.997379 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:56.997349    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bcfcb56c9-x6xsn"]
Oct 30 16:19:57.001477 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.001449    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vfqbl-kcwh5"]
Oct 30 16:19:57.001654 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.001631    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.002586 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.002560    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768cfdff76-wxc2q"]
Oct 30 16:19:57.008390 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.008298    5101 patch_prober.go:29] interesting pod/image-registry-768cfdff76-wxc2q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 16:19:57.008556 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.008458    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q" podUID="4b6aeef2-7878-466d-964c-2a375bdb8f04" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:19:57.019778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.018884    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 16:19:57.019778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.019041    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 16:19:57.020554 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.020529    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-l6fpx\""
Oct 30 16:19:57.020554 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.020531    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 16:19:57.020821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.020803    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-9rfh6"]
Oct 30 16:19:57.022451 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.022429    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 16:19:57.022651 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.022624    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 16:19:57.022921 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.022907    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 16:19:57.023156 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.023136    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bcfcb56c9-x6xsn"]
Oct 30 16:19:57.042011 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.041981    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jskgw\" (UniqueName: \"kubernetes.io/projected/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-kube-api-access-jskgw\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.042011 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042015    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-oauth-serving-cert\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.042204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042039    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-serving-cert\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.042204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042167    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b56e3d45-f38f-408d-bc5e-de16f6de4da6-archives-path\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.042289 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042219    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-service-ca\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.042389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042328    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-tmp\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.042452 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042414    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-oauth-config\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.042498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042451    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5784056-c325-4d6b-afaf-f4f299436097-tmp\") pod \"downloads-6dd789c8b7-9rfh6\" (UID: \"d5784056-c325-4d6b-afaf-f4f299436097\") " pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:19:57.042592 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042537    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-service-ca-bundle\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.042643 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042596    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxn6\" (UniqueName: \"kubernetes.io/projected/b56e3d45-f38f-408d-bc5e-de16f6de4da6-kube-api-access-xxxn6\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.042907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042695    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-trusted-ca-bundle\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.042907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042734    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-config\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.042907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.042777    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn2xd\" (UniqueName: \"kubernetes.io/projected/d5784056-c325-4d6b-afaf-f4f299436097-kube-api-access-sn2xd\") pod \"downloads-6dd789c8b7-9rfh6\" (UID: \"d5784056-c325-4d6b-afaf-f4f299436097\") " pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:19:57.094289 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.094256    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"]
Oct 30 16:19:57.096671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.096648    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65967fb5d5-mjwns"]
Oct 30 16:19:57.096807 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.096760    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"
Oct 30 16:19:57.098981 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.098961    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.119645 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.119618    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qrfjq\""
Oct 30 16:19:57.119840 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.119639    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 30 16:19:57.119931 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.119686    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 16:19:57.120080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.119988    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-djwlv\""
Oct 30 16:19:57.121041 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.121021    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"]
Oct 30 16:19:57.127102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.127076    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65967fb5d5-mjwns"]
Oct 30 16:19:57.143531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143496    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-service-ca-bundle\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.143691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143537    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-registry-tls\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.143691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143567    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxn6\" (UniqueName: \"kubernetes.io/projected/b56e3d45-f38f-408d-bc5e-de16f6de4da6-kube-api-access-xxxn6\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.143691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143629    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61601519-efc4-4541-98e5-2e61c0549970-ca-trust-extracted\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.143691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143668    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61601519-efc4-4541-98e5-2e61c0549970-trusted-ca\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.143859 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143701    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-trusted-ca-bundle\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.143859 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143730    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-config\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.143970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143903    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn2xd\" (UniqueName: \"kubernetes.io/projected/d5784056-c325-4d6b-afaf-f4f299436097-kube-api-access-sn2xd\") pod \"downloads-6dd789c8b7-9rfh6\" (UID: \"d5784056-c325-4d6b-afaf-f4f299436097\") " pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:19:57.143970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143944    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jskgw\" (UniqueName: \"kubernetes.io/projected/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-kube-api-access-jskgw\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144069 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.143976    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-bound-sa-token\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.144069 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144009    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-oauth-serving-cert\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144069 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144042    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61601519-efc4-4541-98e5-2e61c0549970-image-registry-private-configuration\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.144173 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144136    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-serving-cert\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144240 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144220    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b56e3d45-f38f-408d-bc5e-de16f6de4da6-archives-path\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.144319 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144293    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-service-ca\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144349    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61601519-efc4-4541-98e5-2e61c0549970-registry-certificates\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.144409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144362    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-service-ca-bundle\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.144409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144385    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-config\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144553 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144489    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-tmp\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144553 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144525    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-oauth-config\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144558    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61601519-efc4-4541-98e5-2e61c0549970-installation-pull-secrets\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.144644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144589    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3268f679-7d51-4b94-8d73-f67f8268dd23-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-7qx4h\" (UID: \"3268f679-7d51-4b94-8d73-f67f8268dd23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"
Oct 30 16:19:57.144644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144618    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5784056-c325-4d6b-afaf-f4f299436097-tmp\") pod \"downloads-6dd789c8b7-9rfh6\" (UID: \"d5784056-c325-4d6b-afaf-f4f299436097\") " pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:19:57.144644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144621    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b56e3d45-f38f-408d-bc5e-de16f6de4da6-archives-path\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.144644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144641    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gxqs\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-kube-api-access-2gxqs\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.144875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144791    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-tmp\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144828    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-oauth-serving-cert\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.144875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144862    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-trusted-ca-bundle\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.145024 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.144941    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-service-ca\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.145126 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.145106    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5784056-c325-4d6b-afaf-f4f299436097-tmp\") pod \"downloads-6dd789c8b7-9rfh6\" (UID: \"d5784056-c325-4d6b-afaf-f4f299436097\") " pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:19:57.146831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.146804    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-serving-cert\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.146993 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.146972    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-oauth-config\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.160991 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.160961    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:57.166779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.166751    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn2xd\" (UniqueName: \"kubernetes.io/projected/d5784056-c325-4d6b-afaf-f4f299436097-kube-api-access-sn2xd\") pod \"downloads-6dd789c8b7-9rfh6\" (UID: \"d5784056-c325-4d6b-afaf-f4f299436097\") " pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:19:57.166779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.166752    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jskgw\" (UniqueName: \"kubernetes.io/projected/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-kube-api-access-jskgw\") pod \"console-5bcfcb56c9-x6xsn\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") " pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.166963 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.166870    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxn6\" (UniqueName: \"kubernetes.io/projected/b56e3d45-f38f-408d-bc5e-de16f6de4da6-kube-api-access-xxxn6\") pod \"periodic-gathering-vfqbl-kcwh5\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") " pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.189768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.189738    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l8nf9"
Oct 30 16:19:57.245966 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.245872    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61601519-efc4-4541-98e5-2e61c0549970-installation-pull-secrets\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.245966 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.245916    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3268f679-7d51-4b94-8d73-f67f8268dd23-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-7qx4h\" (UID: \"3268f679-7d51-4b94-8d73-f67f8268dd23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"
Oct 30 16:19:57.245966 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.245942    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gxqs\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-kube-api-access-2gxqs\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.246241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.246001    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-registry-tls\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.246241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.246025    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61601519-efc4-4541-98e5-2e61c0549970-ca-trust-extracted\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.246241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.246046    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61601519-efc4-4541-98e5-2e61c0549970-trusted-ca\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.246241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.246116    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-bound-sa-token\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.246241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.246149    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61601519-efc4-4541-98e5-2e61c0549970-image-registry-private-configuration\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.246535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.246247    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61601519-efc4-4541-98e5-2e61c0549970-registry-certificates\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.246535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.246500    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61601519-efc4-4541-98e5-2e61c0549970-ca-trust-extracted\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.247257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.247210    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61601519-efc4-4541-98e5-2e61c0549970-registry-certificates\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.247395 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.247355    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61601519-efc4-4541-98e5-2e61c0549970-trusted-ca\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.248704 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.248679    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-registry-tls\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.248840 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.248817    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3268f679-7d51-4b94-8d73-f67f8268dd23-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-7qx4h\" (UID: \"3268f679-7d51-4b94-8d73-f67f8268dd23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"
Oct 30 16:19:57.248917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.248895    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61601519-efc4-4541-98e5-2e61c0549970-installation-pull-secrets\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.249002 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.248985    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61601519-efc4-4541-98e5-2e61c0549970-image-registry-private-configuration\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.269532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.269495    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:19:57.269808 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.269791    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-bound-sa-token\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.269854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.269836    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gxqs\" (UniqueName: \"kubernetes.io/projected/61601519-efc4-4541-98e5-2e61c0549970-kube-api-access-2gxqs\") pod \"image-registry-65967fb5d5-mjwns\" (UID: \"61601519-efc4-4541-98e5-2e61c0549970\") " pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.314008 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.313976    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:57.326487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.325558    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:19:57.326487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.325741    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:19:57.409423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.409393    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"
Oct 30 16:19:57.414092 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.414015    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:57.469217 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.469192    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:57.570445 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.570420    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vfqbl-kcwh5"]
Oct 30 16:19:57.571888 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:57.571862    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56e3d45_f38f_408d_bc5e_de16f6de4da6.slice/crio-f2125030f89e52fac4100c7abbd78d9606ea8c20c7234f45888373cec476ae0c WatchSource:0}: Error finding container f2125030f89e52fac4100c7abbd78d9606ea8c20c7234f45888373cec476ae0c: Status 404 returned error can't find the container with id f2125030f89e52fac4100c7abbd78d9606ea8c20c7234f45888373cec476ae0c
Oct 30 16:19:57.647856 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.647833    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-9rfh6"]
Oct 30 16:19:57.649425 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:57.649396    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5784056_c325_4d6b_afaf_f4f299436097.slice/crio-198e61a50f2e6749bdce89a85120183198d38b3688d888250070c46070c564f2 WatchSource:0}: Error finding container 198e61a50f2e6749bdce89a85120183198d38b3688d888250070c46070c564f2: Status 404 returned error can't find the container with id 198e61a50f2e6749bdce89a85120183198d38b3688d888250070c46070c564f2
Oct 30 16:19:57.657478 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.656301    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bcfcb56c9-x6xsn"]
Oct 30 16:19:57.657909 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:57.657883    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8042c2_8957_4ccb_b5cd_652cb7e95a7d.slice/crio-d928f2b56888e3f8ef768c9fa0f6ef0d93b7679f9d36f1486db7ae8346e73eef WatchSource:0}: Error finding container d928f2b56888e3f8ef768c9fa0f6ef0d93b7679f9d36f1486db7ae8346e73eef: Status 404 returned error can't find the container with id d928f2b56888e3f8ef768c9fa0f6ef0d93b7679f9d36f1486db7ae8346e73eef
Oct 30 16:19:57.708369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.708326    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"]
Oct 30 16:19:57.709747 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:57.709721    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3268f679_7d51_4b94_8d73_f67f8268dd23.slice/crio-31d4a84f356b2d2cdd7bae2c45920fe2602e9afb45aa9eb0b1692531f7db586d WatchSource:0}: Error finding container 31d4a84f356b2d2cdd7bae2c45920fe2602e9afb45aa9eb0b1692531f7db586d: Status 404 returned error can't find the container with id 31d4a84f356b2d2cdd7bae2c45920fe2602e9afb45aa9eb0b1692531f7db586d
Oct 30 16:19:57.730892 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.730869    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65967fb5d5-mjwns"]
Oct 30 16:19:57.732159 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:57.732136    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61601519_efc4_4541_98e5_2e61c0549970.slice/crio-97179c39025db36be18605669b089ee81c711de153879e55e3066c237cc53e64 WatchSource:0}: Error finding container 97179c39025db36be18605669b089ee81c711de153879e55e3066c237cc53e64: Status 404 returned error can't find the container with id 97179c39025db36be18605669b089ee81c711de153879e55e3066c237cc53e64
Oct 30 16:19:57.952450 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.952419    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:57.952631 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.952505    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:57.953046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.953023    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:57.955388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.955365    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a402821-d2bd-4ebe-a4cb-897a5b3f4625-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wkcqh\" (UID: \"0a402821-d2bd-4ebe-a4cb-897a5b3f4625\") " pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:57.999239 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:57.999187    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wkcqh"
Oct 30 16:19:58.246182 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.246090    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5" event={"ID":"b56e3d45-f38f-408d-bc5e-de16f6de4da6","Type":"ContainerStarted","Data":"1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85"}
Oct 30 16:19:58.246182 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.246154    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5" event={"ID":"b56e3d45-f38f-408d-bc5e-de16f6de4da6","Type":"ContainerStarted","Data":"f2125030f89e52fac4100c7abbd78d9606ea8c20c7234f45888373cec476ae0c"}
Oct 30 16:19:58.249302 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.249243    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:19:58.251823 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.251798    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcfcb56c9-x6xsn" event={"ID":"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d","Type":"ContainerStarted","Data":"d928f2b56888e3f8ef768c9fa0f6ef0d93b7679f9d36f1486db7ae8346e73eef"}
Oct 30 16:19:58.258706 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.257231    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65967fb5d5-mjwns" event={"ID":"61601519-efc4-4541-98e5-2e61c0549970","Type":"ContainerStarted","Data":"a8d9514467e637eab523980d73a2954d5f8eca6fe491f459de8d2d8ca0b9b9f7"}
Oct 30 16:19:58.258706 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.257279    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65967fb5d5-mjwns" event={"ID":"61601519-efc4-4541-98e5-2e61c0549970","Type":"ContainerStarted","Data":"97179c39025db36be18605669b089ee81c711de153879e55e3066c237cc53e64"}
Oct 30 16:19:58.258706 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.257876    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:19:58.260624 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.260600    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h" event={"ID":"3268f679-7d51-4b94-8d73-f67f8268dd23","Type":"ContainerStarted","Data":"31d4a84f356b2d2cdd7bae2c45920fe2602e9afb45aa9eb0b1692531f7db586d"}
Oct 30 16:19:58.262240 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.262208    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-9rfh6" event={"ID":"d5784056-c325-4d6b-afaf-f4f299436097","Type":"ContainerStarted","Data":"198e61a50f2e6749bdce89a85120183198d38b3688d888250070c46070c564f2"}
Oct 30 16:19:58.294995 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.294940    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5" podStartSLOduration=2.294926003 podStartE2EDuration="2.294926003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:58.294286562 +0000 UTC m=+17.347564175" watchObservedRunningTime="2026-10-30 16:19:58.294926003 +0000 UTC m=+17.348203613"
Oct 30 16:19:58.338099 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.338063    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wkcqh"]
Oct 30 16:19:58.339972 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:19:58.339937    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a402821_d2bd_4ebe_a4cb_897a5b3f4625.slice/crio-ab7fe4afb26e93c0a5ead6c373506cfcd8b142f695ca03fb649140bf66c6db34 WatchSource:0}: Error finding container ab7fe4afb26e93c0a5ead6c373506cfcd8b142f695ca03fb649140bf66c6db34: Status 404 returned error can't find the container with id ab7fe4afb26e93c0a5ead6c373506cfcd8b142f695ca03fb649140bf66c6db34
Oct 30 16:19:58.348849 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.348810    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65967fb5d5-mjwns" podStartSLOduration=1.348796301 podStartE2EDuration="1.348796301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:58.340609761 +0000 UTC m=+17.393887373" watchObservedRunningTime="2026-10-30 16:19:58.348796301 +0000 UTC m=+17.402073908"
Oct 30 16:19:58.548271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.547959    5101 patch_prober.go:29] interesting pod/image-registry-7869764d77-758qx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 16:19:58.548271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.548014    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7869764d77-758qx" podUID="afdf3517-540a-470f-b111-043df8f007c5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:19:58.602676 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.602650    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l8nf9_30f743ff-35c0-42c8-9ab1-422606471aa0/dns/0.log"
Oct 30 16:19:58.801516 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:58.801442    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l8nf9_30f743ff-35c0-42c8-9ab1-422606471aa0/kube-rbac-proxy/0.log"
Oct 30 16:19:59.201907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.201875    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4b9s_37d06c87-6ddd-4605-9322-9e13e26eaaa4/dns-node-resolver/0.log"
Oct 30 16:19:59.270934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.270894    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wkcqh" event={"ID":"0a402821-d2bd-4ebe-a4cb-897a5b3f4625","Type":"ContainerStarted","Data":"af2b2aab5e7d8aa4e9dc95fd54bf7db856c7abaa9b03cdf5db14afd88a489db1"}
Oct 30 16:19:59.271099 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.270956    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wkcqh" event={"ID":"0a402821-d2bd-4ebe-a4cb-897a5b3f4625","Type":"ContainerStarted","Data":"8de2cb20d7f26e6f6bc0896be982d66ba436fd38d4b1bbbe837f6f7354133f54"}
Oct 30 16:19:59.271099 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.270980    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wkcqh" event={"ID":"0a402821-d2bd-4ebe-a4cb-897a5b3f4625","Type":"ContainerStarted","Data":"ab7fe4afb26e93c0a5ead6c373506cfcd8b142f695ca03fb649140bf66c6db34"}
Oct 30 16:19:59.273325 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.273299    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h" event={"ID":"3268f679-7d51-4b94-8d73-f67f8268dd23","Type":"ContainerStarted","Data":"382e118f97a84aff85cc1d5d939ad850b5760dcc3985a8e43ec5f8b4dcf131cf"}
Oct 30 16:19:59.273491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.273394    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"
Oct 30 16:19:59.279252 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.279219    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h"
Oct 30 16:19:59.314316 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.314250    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-7qx4h" podStartSLOduration=1.132586048 podStartE2EDuration="2.31423353s" totalImagesPullingTime="1.181647482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:59.312996963 +0000 UTC m=+18.366274574" watchObservedRunningTime="2026-10-30 16:19:59.31423353 +0000 UTC m=+18.367511142"
Oct 30 16:19:59.601826 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.601750    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65967fb5d5-mjwns_61601519-efc4-4541-98e5-2e61c0549970/registry/0.log"
Oct 30 16:19:59.801839 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:19:59.801740    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-768cfdff76-wxc2q_4b6aeef2-7878-466d-964c-2a375bdb8f04/registry/0.log"
Oct 30 16:20:00.001892 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.001788    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7869764d77-758qx_afdf3517-540a-470f-b111-043df8f007c5/registry/0.log"
Oct 30 16:20:00.311935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.311898    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:00.361768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.361733    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-765d57b78d-7d29r"]
Oct 30 16:20:00.367014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.366986    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.373199 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.373174    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"]
Oct 30 16:20:00.387873 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.387847    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.405161 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.401785    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9s5vn_88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd/node-ca/0.log"
Oct 30 16:20:00.410790 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.410759    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 16:20:00.422565 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.422537    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 16:20:00.427372 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.425881    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"]
Oct 30 16:20:00.427372 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.425950    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765d57b78d-7d29r"]
Oct 30 16:20:00.427677 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.427638    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tdfh9\""
Oct 30 16:20:00.427677 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.427662    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 16:20:00.455629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.455597    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484627    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c2hm\" (UniqueName: \"kubernetes.io/projected/69cabfed-c191-4934-8d75-d619653bf44b-kube-api-access-2c2hm\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484674    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-trusted-ca-bundle\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484709    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-service-ca\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484769    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-console-config\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484791    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484827    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-serving-cert\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484845    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69cabfed-c191-4934-8d75-d619653bf44b-tmp\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484863    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484899    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-oauth-config\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484923    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85xjt\" (UniqueName: \"kubernetes.io/projected/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-kube-api-access-85xjt\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484948    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-oauth-serving-cert\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.484965    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.485383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.485320    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 16:20:00.586161 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586081    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69cabfed-c191-4934-8d75-d619653bf44b-tmp\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.586161 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586127    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.586401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586164    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-oauth-config\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.586401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586186    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85xjt\" (UniqueName: \"kubernetes.io/projected/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-kube-api-access-85xjt\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.586401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586213    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-oauth-serving-cert\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.586401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586235    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.586401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586269    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2hm\" (UniqueName: \"kubernetes.io/projected/69cabfed-c191-4934-8d75-d619653bf44b-kube-api-access-2c2hm\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.586401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586300    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-trusted-ca-bundle\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.586401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586331    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-service-ca\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.586729 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586430    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-console-config\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.586729 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586476    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.586729 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.586541    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-serving-cert\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.588074 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.588048    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-oauth-serving-cert\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.588959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.588507    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.588959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.588715    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69cabfed-c191-4934-8d75-d619653bf44b-tmp\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.589192 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.589166    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-service-ca\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.589783 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.589744    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-console-config\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.590052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.590032    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-trusted-ca-bundle\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.590244 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.590224    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-oauth-config\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.594874 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.594850    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-serving-cert\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.595783 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.595764    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.595858 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.595826    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.601285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.601205    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:00.612720 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.612644    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c2hm\" (UniqueName: \"kubernetes.io/projected/69cabfed-c191-4934-8d75-d619653bf44b-kube-api-access-2c2hm\") pod \"console-765d57b78d-7d29r\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") " pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.613819 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.613796    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85xjt\" (UniqueName: \"kubernetes.io/projected/9fbd12a1-795c-4c0e-b286-dd3799a0f9c4-kube-api-access-85xjt\") pod \"prometheus-operator-9cd89b74c-m46tl\" (UID: \"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.692026 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.691990    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:00.713007 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.712971    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"
Oct 30 16:20:00.807406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:00.802958    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9f769b7d5-g6vn9_fcb660ae-8c6a-42ec-bd90-484b9497250b/router/0.log"
Oct 30 16:20:01.001959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:01.001934    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbczx_64de0045-bcde-40a0-938e-d2eeee30f20c/serve-healthcheck-canary/0.log"
Oct 30 16:20:01.047301 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:01.047143    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765d57b78d-7d29r"]
Oct 30 16:20:01.050050 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:20:01.050018    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69cabfed_c191_4934_8d75_d619653bf44b.slice/crio-d5534e084a3ce0d93da926b5c139adea6cc97597f8616e2327210d6f2c46b012 WatchSource:0}: Error finding container d5534e084a3ce0d93da926b5c139adea6cc97597f8616e2327210d6f2c46b012: Status 404 returned error can't find the container with id d5534e084a3ce0d93da926b5c139adea6cc97597f8616e2327210d6f2c46b012
Oct 30 16:20:01.052918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:01.052894    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-m46tl"]
Oct 30 16:20:01.061247 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:20:01.061217    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbd12a1_795c_4c0e_b286_dd3799a0f9c4.slice/crio-1abc5cc833f0299d17f7c18a9107409a432553871bcab4684f8abcc295b20288 WatchSource:0}: Error finding container 1abc5cc833f0299d17f7c18a9107409a432553871bcab4684f8abcc295b20288: Status 404 returned error can't find the container with id 1abc5cc833f0299d17f7c18a9107409a432553871bcab4684f8abcc295b20288
Oct 30 16:20:01.293421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:01.293322    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765d57b78d-7d29r" event={"ID":"69cabfed-c191-4934-8d75-d619653bf44b","Type":"ContainerStarted","Data":"d5534e084a3ce0d93da926b5c139adea6cc97597f8616e2327210d6f2c46b012"}
Oct 30 16:20:01.298820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:01.298783    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wkcqh" event={"ID":"0a402821-d2bd-4ebe-a4cb-897a5b3f4625","Type":"ContainerStarted","Data":"9d0befb8d1014d235f20762a09277f11e6b7b5bb1a4f79154e4ebf6645f9e421"}
Oct 30 16:20:01.300114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:01.300086    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl" event={"ID":"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4","Type":"ContainerStarted","Data":"1abc5cc833f0299d17f7c18a9107409a432553871bcab4684f8abcc295b20288"}
Oct 30 16:20:02.113107 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:02.113068    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:02.254007 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:02.253972    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:02.307881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:02.307812    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcfcb56c9-x6xsn" event={"ID":"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d","Type":"ContainerStarted","Data":"6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df"}
Oct 30 16:20:02.309704 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:02.309659    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765d57b78d-7d29r" event={"ID":"69cabfed-c191-4934-8d75-d619653bf44b","Type":"ContainerStarted","Data":"9fe208866e6785cbca74d0b946c870445e599207a79c102cc594cc5fcd47341b"}
Oct 30 16:20:02.351125 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:02.351063    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5bcfcb56c9-x6xsn" podStartSLOduration=2.710776008 podStartE2EDuration="6.351045463s" totalImagesPullingTime="3.640269455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:02.349533536 +0000 UTC m=+21.402811158" watchObservedRunningTime="2026-10-30 16:20:02.351045463 +0000 UTC m=+21.404323074"
Oct 30 16:20:02.393832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:02.393772    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-765d57b78d-7d29r" podStartSLOduration=2.03674515 podStartE2EDuration="2.393756053s" totalImagesPullingTime="357.010903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:02.392627722 +0000 UTC m=+21.445905333" watchObservedRunningTime="2026-10-30 16:20:02.393756053 +0000 UTC m=+21.447033729"
Oct 30 16:20:02.988107 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:02.988069    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:03.067775 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:03.067740    5101 scope.go:122] "RemoveContainer" containerID="f13b44d6d4657859c790392710da705ef1733cd298aaaaac51e6370af5a8b495"
Oct 30 16:20:03.171711 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:03.171660    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:03.317518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:03.317416    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl" event={"ID":"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4","Type":"ContainerStarted","Data":"afc79036910b82775a84d251297d14d4e7c28317c16b800beed528455334d065"}
Oct 30 16:20:03.317731 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:03.317707    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl" event={"ID":"9fbd12a1-795c-4c0e-b286-dd3799a0f9c4","Type":"ContainerStarted","Data":"d3af5bda1ca3cf4eebb70bcce0351d6ee37202f6a281bed2864eb3d47029a522"}
Oct 30 16:20:03.319870 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:03.319799    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-zfp2k" event={"ID":"d28bb413-77af-4b21-9ee8-489c521b4603","Type":"ContainerStarted","Data":"d9ccd7591ed97288ebfdf25179bf9338d49be7b596c0db0486974cec0a9435bc"}
Oct 30 16:20:03.323828 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:03.323787    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:03.358586 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:03.358529    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m46tl" podStartSLOduration=1.9693006 podStartE2EDuration="3.358515066s" totalImagesPullingTime="1.389214466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:03.358328897 +0000 UTC m=+22.411606508" watchObservedRunningTime="2026-10-30 16:20:03.358515066 +0000 UTC m=+22.411792676"
Oct 30 16:20:05.777492 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:05.777454    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:05.927705 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:05.927668    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:06.041782 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.041699    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x72vf"]
Oct 30 16:20:06.081257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.081199    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.097362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.097263    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 16:20:06.106175 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.106150    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:06.108843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.108816    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 16:20:06.108969 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.108819    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fjt7p\""
Oct 30 16:20:06.108969 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.108936    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 16:20:06.143683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.143647    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84hhb\" (UniqueName: \"kubernetes.io/projected/0809b322-bdca-402c-ac9a-6f3fc3a8a760-kube-api-access-84hhb\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.143863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.143772    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-accelerators-collector-config\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.143863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.143828    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-wtmp\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.143863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.143859    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-root\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.144016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.143905    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-textfile\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.144016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.143939    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-tls\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.144117 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.144070    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-sys\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.144171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.144124    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.144171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.144156    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0809b322-bdca-402c-ac9a-6f3fc3a8a760-metrics-client-ca\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245391    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-accelerators-collector-config\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245449    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-wtmp\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245488    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-root\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245521    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-textfile\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245546    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-tls\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245584    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-sys\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245621    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245628    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-root\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245644    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-wtmp\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245655    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0809b322-bdca-402c-ac9a-6f3fc3a8a760-metrics-client-ca\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245708    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84hhb\" (UniqueName: \"kubernetes.io/projected/0809b322-bdca-402c-ac9a-6f3fc3a8a760-kube-api-access-84hhb\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.245942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245715    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0809b322-bdca-402c-ac9a-6f3fc3a8a760-sys\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.246226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.245961    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-accelerators-collector-config\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.246288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.246268    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-textfile\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.246918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.246517    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0809b322-bdca-402c-ac9a-6f3fc3a8a760-metrics-client-ca\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.248132 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.248112    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-tls\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.248896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.248877    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0809b322-bdca-402c-ac9a-6f3fc3a8a760-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.268787 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.268665    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:06.269669 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.269646    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84hhb\" (UniqueName: \"kubernetes.io/projected/0809b322-bdca-402c-ac9a-6f3fc3a8a760-kube-api-access-84hhb\") pod \"node-exporter-x72vf\" (UID: \"0809b322-bdca-402c-ac9a-6f3fc3a8a760\") " pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.436969 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.436930    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:06.447785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.447757    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x72vf"
Oct 30 16:20:06.495636 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:20:06.495594    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0809b322_bdca_402c_ac9a_6f3fc3a8a760.slice/crio-ff472700cb3cecddcab2d8dc5399340922a6f463e71226ac9131068e7a73f6ef WatchSource:0}: Error finding container ff472700cb3cecddcab2d8dc5399340922a6f463e71226ac9131068e7a73f6ef: Status 404 returned error can't find the container with id ff472700cb3cecddcab2d8dc5399340922a6f463e71226ac9131068e7a73f6ef
Oct 30 16:20:06.603216 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.603180    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:06.750143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.750067    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:20:06.911872 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:06.911833    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:07.008767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.008693    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:20:07.143666 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.143607    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:07.298627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.298518    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:07.326425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.326395    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:20:07.326596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.326495    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:20:07.333043 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.333016    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:20:07.345452 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.345369    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x72vf" event={"ID":"0809b322-bdca-402c-ac9a-6f3fc3a8a760","Type":"ContainerStarted","Data":"ff472700cb3cecddcab2d8dc5399340922a6f463e71226ac9131068e7a73f6ef"}
Oct 30 16:20:07.350611 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.350588    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:20:07.451778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:07.451691    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:08.292499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:08.292418    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7c4px"
Oct 30 16:20:08.351328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:08.351288    5101 generic.go:356] "Generic (PLEG): container finished" podID="0809b322-bdca-402c-ac9a-6f3fc3a8a760" containerID="46e494c2520fd2ed9a53dadb24c5caebf93367d7ed4289dc2c2b63842305d737" exitCode=0
Oct 30 16:20:08.351523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:08.351492    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x72vf" event={"ID":"0809b322-bdca-402c-ac9a-6f3fc3a8a760","Type":"ContainerDied","Data":"46e494c2520fd2ed9a53dadb24c5caebf93367d7ed4289dc2c2b63842305d737"}
Oct 30 16:20:08.659029 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:08.658986    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:08.964765 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:08.964729    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:09.120535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:09.120498    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:09.359862 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:09.359762    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x72vf" event={"ID":"0809b322-bdca-402c-ac9a-6f3fc3a8a760","Type":"ContainerStarted","Data":"8b3535bf95922479292990e3f4d542fcb4215739138956c590b0b8a1222f3c39"}
Oct 30 16:20:09.359862 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:09.359844    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x72vf" event={"ID":"0809b322-bdca-402c-ac9a-6f3fc3a8a760","Type":"ContainerStarted","Data":"bb84ecf07f19bd0d65d08263183b6aac3895c7baadb7c0079632562acf2b0a1a"}
Oct 30 16:20:09.370501 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:09.370473    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:09.417386 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:09.417317    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x72vf" podStartSLOduration=1.8448332330000001 podStartE2EDuration="3.417298644s" totalImagesPullingTime="1.475760052s" totalInitContainerRuntime="96.705359ms" isStatefulPod=true podCreationTimestamp="2026-10-30 16:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:09.41570913 +0000 UTC m=+28.468986742" watchObservedRunningTime="2026-10-30 16:20:09.417298644 +0000 UTC m=+28.470576258"
Oct 30 16:20:09.528113 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:09.528074    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:09.677083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:09.677049    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:10.692707 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:10.692670    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:10.693194 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:10.692724    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:10.700266 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:10.700058    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:10.776721 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:10.776691    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:10.896314 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:10.896280    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765d57b78d-7d29r"]
Oct 30 16:20:10.939265 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:10.939219    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:11.082181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:11.082109    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:11.375678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:11.375594    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:12.365496 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:12.365458    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:13.126793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:13.126754    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:14.611589 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:14.611556    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:14.748078 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:14.748049    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:15.289274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:15.289238    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:15.396040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:15.396001    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-9rfh6" event={"ID":"d5784056-c325-4d6b-afaf-f4f299436097","Type":"ContainerStarted","Data":"0d0e76051b4c68e9f4f417bad0dbbb16583ecb4588d9b9a25768388e1ad725f4"}
Oct 30 16:20:15.396222 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:15.396190    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:20:15.397908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:15.397884    5101 patch_prober.go:29] interesting pod/downloads-6dd789c8b7-9rfh6 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.29:8080/\": dial tcp 10.132.0.29:8080: connect: connection refused" start-of-body=
Oct 30 16:20:15.398021 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:15.397927    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6dd789c8b7-9rfh6" podUID="d5784056-c325-4d6b-afaf-f4f299436097" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.29:8080/\": dial tcp 10.132.0.29:8080: connect: connection refused"
Oct 30 16:20:15.430093 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:15.430067    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:15.451502 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:15.451447    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-9rfh6" podStartSLOduration=2.0027784 podStartE2EDuration="19.451430295s" totalImagesPullingTime="17.448651895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:15.45087131 +0000 UTC m=+34.504148921" watchObservedRunningTime="2026-10-30 16:20:15.451430295 +0000 UTC m=+34.504707906"
Oct 30 16:20:16.389255 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:16.389187    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:16.423469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:16.423441    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-9rfh6"
Oct 30 16:20:20.291503 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:20.291467    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65967fb5d5-mjwns"
Oct 30 16:20:20.337869 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:20:20.337830    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:20:20.417102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:20.417074    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7869764d77-758qx"]
Oct 30 16:20:20.565270 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:20.565147    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:20.720083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:20.720049    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:20.879883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:20.879789    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:22.031730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.031659    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q" podUID="4b6aeef2-7878-466d-964c-2a375bdb8f04" containerName="registry" containerID="cri-o://bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef" gracePeriod=30
Oct 30 16:20:22.165621 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.165582    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bcfcb56c9-x6xsn"]
Oct 30 16:20:22.257089 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.256930    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:22.362273 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.362247    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:20:22.412057 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.412003    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:22.454997 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.454955    5101 generic.go:356] "Generic (PLEG): container finished" podID="4b6aeef2-7878-466d-964c-2a375bdb8f04" containerID="bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef" exitCode=0
Oct 30 16:20:22.455201 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.455018    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q"
Oct 30 16:20:22.455201 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.455029    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q" event={"ID":"4b6aeef2-7878-466d-964c-2a375bdb8f04","Type":"ContainerDied","Data":"bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef"}
Oct 30 16:20:22.455201 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.455083    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768cfdff76-wxc2q" event={"ID":"4b6aeef2-7878-466d-964c-2a375bdb8f04","Type":"ContainerDied","Data":"bb6810e74c1b3b4a57612ec199eb611f8926dd20dbd4617bf0c3de3d20e4d505"}
Oct 30 16:20:22.455201 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.455115    5101 scope.go:122] "RemoveContainer" containerID="bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef"
Oct 30 16:20:22.466296 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.466275    5101 scope.go:122] "RemoveContainer" containerID="bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef"
Oct 30 16:20:22.466675 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:20:22.466651    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef\": container with ID starting with bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef not found: ID does not exist" containerID="bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef"
Oct 30 16:20:22.466770 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.466682    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef"} err="failed to get container status \"bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef\": rpc error: code = NotFound desc = could not find container \"bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef\": container with ID starting with bd4cf37d9ffe93f692ce85c9cc29808e1d4d805fd6c79aa5e51c43990bdac8ef not found: ID does not exist"
Oct 30 16:20:22.523361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.523302    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates\") pod \"4b6aeef2-7878-466d-964c-2a375bdb8f04\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") "
Oct 30 16:20:22.523564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.523366    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted\") pod \"4b6aeef2-7878-466d-964c-2a375bdb8f04\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") "
Oct 30 16:20:22.523564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.523423    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt\") pod \"4b6aeef2-7878-466d-964c-2a375bdb8f04\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") "
Oct 30 16:20:22.523564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.523475    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets\") pod \"4b6aeef2-7878-466d-964c-2a375bdb8f04\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") "
Oct 30 16:20:22.523564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.523505    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token\") pod \"4b6aeef2-7878-466d-964c-2a375bdb8f04\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") "
Oct 30 16:20:22.523778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.523567    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration\") pod \"4b6aeef2-7878-466d-964c-2a375bdb8f04\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") "
Oct 30 16:20:22.523778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.523616    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") pod \"4b6aeef2-7878-466d-964c-2a375bdb8f04\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") "
Oct 30 16:20:22.523778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.523718    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca\") pod \"4b6aeef2-7878-466d-964c-2a375bdb8f04\" (UID: \"4b6aeef2-7878-466d-964c-2a375bdb8f04\") "
Oct 30 16:20:22.524547 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.524510    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates" pod "4b6aeef2-7878-466d-964c-2a375bdb8f04" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:22.524665 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.524561    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca" pod "4b6aeef2-7878-466d-964c-2a375bdb8f04" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:22.532474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.532438    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted" pod "4b6aeef2-7878-466d-964c-2a375bdb8f04" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:22.535478 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.534466    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration" pod "4b6aeef2-7878-466d-964c-2a375bdb8f04" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:22.536505 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.536468    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token" pod "4b6aeef2-7878-466d-964c-2a375bdb8f04" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:22.536623 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.536602    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt" pod "4b6aeef2-7878-466d-964c-2a375bdb8f04" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04"). InnerVolumeSpecName "kube-api-access-5t5zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:22.536675 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.536599    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls" pod "4b6aeef2-7878-466d-964c-2a375bdb8f04" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:22.542603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.542573    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets" pod "4b6aeef2-7878-466d-964c-2a375bdb8f04" (UID: "4b6aeef2-7878-466d-964c-2a375bdb8f04"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:22.625404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.625290    5101 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-image-registry-private-configuration\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:22.625404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.625333    5101 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-tls\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:22.625404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.625376    5101 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-trusted-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:22.625404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.625389    5101 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b6aeef2-7878-466d-964c-2a375bdb8f04-registry-certificates\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:22.625404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.625405    5101 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b6aeef2-7878-466d-964c-2a375bdb8f04-ca-trust-extracted\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:22.625770 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.625418    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t5zt\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-kube-api-access-5t5zt\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:22.625770 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.625430    5101 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b6aeef2-7878-466d-964c-2a375bdb8f04-installation-pull-secrets\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:22.625770 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.625441    5101 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b6aeef2-7878-466d-964c-2a375bdb8f04-bound-sa-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:22.808254 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.808217    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768cfdff76-wxc2q"]
Oct 30 16:20:22.820677 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:22.820637    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-768cfdff76-wxc2q"]
Oct 30 16:20:23.074800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:23.074764    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b6aeef2-7878-466d-964c-2a375bdb8f04" path="/var/lib/kubelet/pods/4b6aeef2-7878-466d-964c-2a375bdb8f04/volumes"
Oct 30 16:20:23.385487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:23.385348    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:23.623312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:23.623277    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:23.767834 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:23.767797    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:25.229574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:25.229538    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:25.381115 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:25.381079    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:26.165378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:26.165350    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:26.373030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:26.372994    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:28.484510 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.484460    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vfqbl-kcwh5"]
Oct 30 16:20:28.484956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.484670    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5" podUID="b56e3d45-f38f-408d-bc5e-de16f6de4da6" containerName="insights-gathering" containerID="cri-o://1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85" gracePeriod=30
Oct 30 16:20:28.489043 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.489021    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-b82vr-4mwk6"]
Oct 30 16:20:28.489218 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.489201    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-b82vr-4mwk6" podUID="548f7cd0-4adf-403f-b879-fb8be191d374" containerName="insights-gathering" containerID="cri-o://e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0" gracePeriod=30
Oct 30 16:20:28.811569 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.811541    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:20:28.831534 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.831508    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:20:28.989629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989597    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path\") pod \"548f7cd0-4adf-403f-b879-fb8be191d374\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") "
Oct 30 16:20:28.989793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989644    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle\") pod \"548f7cd0-4adf-403f-b879-fb8be191d374\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") "
Oct 30 16:20:28.989793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989680    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-service-ca-bundle\") pod \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") "
Oct 30 16:20:28.989793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989718    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b56e3d45-f38f-408d-bc5e-de16f6de4da6-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b56e3d45-f38f-408d-bc5e-de16f6de4da6-archives-path\") pod \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") "
Oct 30 16:20:28.989793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989756    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b56e3d45-f38f-408d-bc5e-de16f6de4da6-kube-api-access-xxxn6\" (UniqueName: \"kubernetes.io/projected/b56e3d45-f38f-408d-bc5e-de16f6de4da6-kube-api-access-xxxn6\") pod \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") "
Oct 30 16:20:28.989793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989785    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle\") pod \"548f7cd0-4adf-403f-b879-fb8be191d374\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") "
Oct 30 16:20:28.990052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989850    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8\" (UniqueName: \"kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8\") pod \"548f7cd0-4adf-403f-b879-fb8be191d374\" (UID: \"548f7cd0-4adf-403f-b879-fb8be191d374\") "
Oct 30 16:20:28.990052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989894    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-trusted-ca-bundle\") pod \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\" (UID: \"b56e3d45-f38f-408d-bc5e-de16f6de4da6\") "
Oct 30 16:20:28.990052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.989991    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path" pod "548f7cd0-4adf-403f-b879-fb8be191d374" (UID: "548f7cd0-4adf-403f-b879-fb8be191d374"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:28.990214 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990077    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle" pod "548f7cd0-4adf-403f-b879-fb8be191d374" (UID: "548f7cd0-4adf-403f-b879-fb8be191d374"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:28.990214 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990083    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56e3d45-f38f-408d-bc5e-de16f6de4da6-archives-path" pod "b56e3d45-f38f-408d-bc5e-de16f6de4da6" (UID: "b56e3d45-f38f-408d-bc5e-de16f6de4da6"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:28.990214 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990117    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-service-ca-bundle" pod "b56e3d45-f38f-408d-bc5e-de16f6de4da6" (UID: "b56e3d45-f38f-408d-bc5e-de16f6de4da6"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:28.990214 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990197    5101 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/548f7cd0-4adf-403f-b879-fb8be191d374-archives-path\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:28.990457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990216    5101 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-service-ca-bundle\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:28.990457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990299    5101 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-service-ca-bundle\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:28.990457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990314    5101 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b56e3d45-f38f-408d-bc5e-de16f6de4da6-archives-path\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:28.990457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990429    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-trusted-ca-bundle" pod "b56e3d45-f38f-408d-bc5e-de16f6de4da6" (UID: "b56e3d45-f38f-408d-bc5e-de16f6de4da6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:28.990603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.990559    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle" pod "548f7cd0-4adf-403f-b879-fb8be191d374" (UID: "548f7cd0-4adf-403f-b879-fb8be191d374"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:28.992039 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.992011    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b56e3d45-f38f-408d-bc5e-de16f6de4da6-kube-api-access-xxxn6" pod "b56e3d45-f38f-408d-bc5e-de16f6de4da6" (UID: "b56e3d45-f38f-408d-bc5e-de16f6de4da6"). InnerVolumeSpecName "kube-api-access-xxxn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:28.992099 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:28.992052    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8" pod "548f7cd0-4adf-403f-b879-fb8be191d374" (UID: "548f7cd0-4adf-403f-b879-fb8be191d374"). InnerVolumeSpecName "kube-api-access-vzqv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:29.091085 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.091062    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxxn6\" (UniqueName: \"kubernetes.io/projected/b56e3d45-f38f-408d-bc5e-de16f6de4da6-kube-api-access-xxxn6\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:29.091085 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.091086    5101 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548f7cd0-4adf-403f-b879-fb8be191d374-trusted-ca-bundle\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:29.091219 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.091096    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzqv8\" (UniqueName: \"kubernetes.io/projected/548f7cd0-4adf-403f-b879-fb8be191d374-kube-api-access-vzqv8\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:29.091219 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.091104    5101 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56e3d45-f38f-408d-bc5e-de16f6de4da6-trusted-ca-bundle\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:29.489090 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.489053    5101 generic.go:356] "Generic (PLEG): container finished" podID="b56e3d45-f38f-408d-bc5e-de16f6de4da6" containerID="1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85" exitCode=2
Oct 30 16:20:29.489591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.489098    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5"
Oct 30 16:20:29.489591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.489146    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5" event={"ID":"b56e3d45-f38f-408d-bc5e-de16f6de4da6","Type":"ContainerDied","Data":"1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85"}
Oct 30 16:20:29.489591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.489203    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vfqbl-kcwh5" event={"ID":"b56e3d45-f38f-408d-bc5e-de16f6de4da6","Type":"ContainerDied","Data":"f2125030f89e52fac4100c7abbd78d9606ea8c20c7234f45888373cec476ae0c"}
Oct 30 16:20:29.489591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.489228    5101 scope.go:122] "RemoveContainer" containerID="1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85"
Oct 30 16:20:29.491128 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.491103    5101 generic.go:356] "Generic (PLEG): container finished" podID="548f7cd0-4adf-403f-b879-fb8be191d374" containerID="e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0" exitCode=2
Oct 30 16:20:29.491310 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.491151    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-b82vr-4mwk6" event={"ID":"548f7cd0-4adf-403f-b879-fb8be191d374","Type":"ContainerDied","Data":"e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0"}
Oct 30 16:20:29.491310 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.491184    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-b82vr-4mwk6" event={"ID":"548f7cd0-4adf-403f-b879-fb8be191d374","Type":"ContainerDied","Data":"5e73996eb8296158509bed53e8ecf389b5475dbe41a9fe4026dbcf52f5d89872"}
Oct 30 16:20:29.491310 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.491239    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-b82vr-4mwk6"
Oct 30 16:20:29.499557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.499534    5101 scope.go:122] "RemoveContainer" containerID="1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85"
Oct 30 16:20:29.499839 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:20:29.499820    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85\": container with ID starting with 1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85 not found: ID does not exist" containerID="1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85"
Oct 30 16:20:29.499912 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.499847    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85"} err="failed to get container status \"1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85\": rpc error: code = NotFound desc = could not find container \"1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85\": container with ID starting with 1effd5072e506131cf2e48a09c8d297871d154681495c8c058a3842937877a85 not found: ID does not exist"
Oct 30 16:20:29.499912 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.499865    5101 scope.go:122] "RemoveContainer" containerID="e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0"
Oct 30 16:20:29.507857 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.507838    5101 scope.go:122] "RemoveContainer" containerID="e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0"
Oct 30 16:20:29.508131 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:20:29.508112    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0\": container with ID starting with e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0 not found: ID does not exist" containerID="e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0"
Oct 30 16:20:29.508183 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.508137    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0"} err="failed to get container status \"e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0\": rpc error: code = NotFound desc = could not find container \"e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0\": container with ID starting with e2f8b234d5458e702283abe3ae260e229cffa250db533d939b378d65b16d67d0 not found: ID does not exist"
Oct 30 16:20:29.543828 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.543800    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vfqbl-kcwh5"]
Oct 30 16:20:29.555602 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.555575    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-vfqbl-kcwh5"]
Oct 30 16:20:29.592702 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.592670    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-b82vr-4mwk6"]
Oct 30 16:20:29.596298 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:29.596273    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-b82vr-4mwk6"]
Oct 30 16:20:30.780518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:30.780483    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:30.987231 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:30.987196    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:31.072166 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:31.072062    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="548f7cd0-4adf-403f-b879-fb8be191d374" path="/var/lib/kubelet/pods/548f7cd0-4adf-403f-b879-fb8be191d374/volumes"
Oct 30 16:20:31.072587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:31.072566    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b56e3d45-f38f-408d-bc5e-de16f6de4da6" path="/var/lib/kubelet/pods/b56e3d45-f38f-408d-bc5e-de16f6de4da6/volumes"
Oct 30 16:20:37.397971 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.397929    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-765d57b78d-7d29r" podUID="69cabfed-c191-4934-8d75-d619653bf44b" containerName="console" containerID="cri-o://9fe208866e6785cbca74d0b946c870445e599207a79c102cc594cc5fcd47341b" gracePeriod=15
Oct 30 16:20:37.529018 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.528991    5101 generic.go:356] "Generic (PLEG): container finished" podID="69cabfed-c191-4934-8d75-d619653bf44b" containerID="9fe208866e6785cbca74d0b946c870445e599207a79c102cc594cc5fcd47341b" exitCode=0
Oct 30 16:20:37.529140 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.529067    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765d57b78d-7d29r" event={"ID":"69cabfed-c191-4934-8d75-d619653bf44b","Type":"ContainerDied","Data":"9fe208866e6785cbca74d0b946c870445e599207a79c102cc594cc5fcd47341b"}
Oct 30 16:20:37.673544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.673481    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:37.761069 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761038    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69cabfed-c191-4934-8d75-d619653bf44b-kube-api-access-2c2hm\" (UniqueName: \"kubernetes.io/projected/69cabfed-c191-4934-8d75-d619653bf44b-kube-api-access-2c2hm\") pod \"69cabfed-c191-4934-8d75-d619653bf44b\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") "
Oct 30 16:20:37.761256 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761076    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69cabfed-c191-4934-8d75-d619653bf44b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/69cabfed-c191-4934-8d75-d619653bf44b-tmp\") pod \"69cabfed-c191-4934-8d75-d619653bf44b\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") "
Oct 30 16:20:37.761256 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761131    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-oauth-serving-cert\") pod \"69cabfed-c191-4934-8d75-d619653bf44b\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") "
Oct 30 16:20:37.761256 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761176    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-console-config\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-console-config\") pod \"69cabfed-c191-4934-8d75-d619653bf44b\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") "
Oct 30 16:20:37.761256 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761201    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-trusted-ca-bundle\") pod \"69cabfed-c191-4934-8d75-d619653bf44b\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") "
Oct 30 16:20:37.761256 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761219    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-serving-cert\") pod \"69cabfed-c191-4934-8d75-d619653bf44b\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") "
Oct 30 16:20:37.761256 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761255    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-service-ca\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-service-ca\") pod \"69cabfed-c191-4934-8d75-d619653bf44b\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") "
Oct 30 16:20:37.761609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761282    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-oauth-config\") pod \"69cabfed-c191-4934-8d75-d619653bf44b\" (UID: \"69cabfed-c191-4934-8d75-d619653bf44b\") "
Oct 30 16:20:37.761609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761412    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69cabfed-c191-4934-8d75-d619653bf44b-tmp" pod "69cabfed-c191-4934-8d75-d619653bf44b" (UID: "69cabfed-c191-4934-8d75-d619653bf44b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:37.761609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761585    5101 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69cabfed-c191-4934-8d75-d619653bf44b-tmp\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:37.761751 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761643    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-oauth-serving-cert" pod "69cabfed-c191-4934-8d75-d619653bf44b" (UID: "69cabfed-c191-4934-8d75-d619653bf44b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:37.761751 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761730    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-service-ca" pod "69cabfed-c191-4934-8d75-d619653bf44b" (UID: "69cabfed-c191-4934-8d75-d619653bf44b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:37.761869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761745    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-trusted-ca-bundle" pod "69cabfed-c191-4934-8d75-d619653bf44b" (UID: "69cabfed-c191-4934-8d75-d619653bf44b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:37.761869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.761752    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-console-config" pod "69cabfed-c191-4934-8d75-d619653bf44b" (UID: "69cabfed-c191-4934-8d75-d619653bf44b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:37.763521 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.763498    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69cabfed-c191-4934-8d75-d619653bf44b-kube-api-access-2c2hm" pod "69cabfed-c191-4934-8d75-d619653bf44b" (UID: "69cabfed-c191-4934-8d75-d619653bf44b"). InnerVolumeSpecName "kube-api-access-2c2hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:37.763658 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.763617    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-oauth-config" pod "69cabfed-c191-4934-8d75-d619653bf44b" (UID: "69cabfed-c191-4934-8d75-d619653bf44b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:37.763709 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.763670    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-serving-cert" pod "69cabfed-c191-4934-8d75-d619653bf44b" (UID: "69cabfed-c191-4934-8d75-d619653bf44b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:37.862752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.862717    5101 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-console-config\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:37.862752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.862745    5101 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-trusted-ca-bundle\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:37.862752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.862755    5101 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-serving-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:37.862973 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.862765    5101 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-service-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:37.862973 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.862773    5101 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69cabfed-c191-4934-8d75-d619653bf44b-console-oauth-config\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:37.862973 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.862781    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c2hm\" (UniqueName: \"kubernetes.io/projected/69cabfed-c191-4934-8d75-d619653bf44b-kube-api-access-2c2hm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:37.862973 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:37.862791    5101 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69cabfed-c191-4934-8d75-d619653bf44b-oauth-serving-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:38.535267 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:38.535234    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765d57b78d-7d29r" event={"ID":"69cabfed-c191-4934-8d75-d619653bf44b","Type":"ContainerDied","Data":"d5534e084a3ce0d93da926b5c139adea6cc97597f8616e2327210d6f2c46b012"}
Oct 30 16:20:38.535267 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:38.535265    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765d57b78d-7d29r"
Oct 30 16:20:38.535780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:38.535328    5101 scope.go:122] "RemoveContainer" containerID="9fe208866e6785cbca74d0b946c870445e599207a79c102cc594cc5fcd47341b"
Oct 30 16:20:38.586251 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:38.586218    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765d57b78d-7d29r"]
Oct 30 16:20:38.598312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:38.598288    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-765d57b78d-7d29r"]
Oct 30 16:20:38.632017 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:38.631987    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:38.808927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:38.808844    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:39.072544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:39.072468    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69cabfed-c191-4934-8d75-d619653bf44b" path="/var/lib/kubelet/pods/69cabfed-c191-4934-8d75-d619653bf44b/volumes"
Oct 30 16:20:45.442080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.442020    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7869764d77-758qx" podUID="afdf3517-540a-470f-b111-043df8f007c5" containerName="registry" containerID="cri-o://5d710c5cc6525f4c5556b9eae0be8d70551b1bba260a9a3b4012c6975dd441c5" gracePeriod=30
Oct 30 16:20:45.566128 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.566096    5101 generic.go:356] "Generic (PLEG): container finished" podID="afdf3517-540a-470f-b111-043df8f007c5" containerID="5d710c5cc6525f4c5556b9eae0be8d70551b1bba260a9a3b4012c6975dd441c5" exitCode=0
Oct 30 16:20:45.566269 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.566164    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869764d77-758qx" event={"ID":"afdf3517-540a-470f-b111-043df8f007c5","Type":"ContainerDied","Data":"5d710c5cc6525f4c5556b9eae0be8d70551b1bba260a9a3b4012c6975dd441c5"}
Oct 30 16:20:45.732439 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.732409    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:20:45.833653 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.833622    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca\") pod \"afdf3517-540a-470f-b111-043df8f007c5\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") "
Oct 30 16:20:45.833653 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.833662    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates\") pod \"afdf3517-540a-470f-b111-043df8f007c5\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") "
Oct 30 16:20:45.833927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.833711    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted\") pod \"afdf3517-540a-470f-b111-043df8f007c5\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") "
Oct 30 16:20:45.833927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.833774    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets\") pod \"afdf3517-540a-470f-b111-043df8f007c5\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") "
Oct 30 16:20:45.833927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.833816    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") pod \"afdf3517-540a-470f-b111-043df8f007c5\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") "
Oct 30 16:20:45.833927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.833880    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration\") pod \"afdf3517-540a-470f-b111-043df8f007c5\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") "
Oct 30 16:20:45.833927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.833922    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7\") pod \"afdf3517-540a-470f-b111-043df8f007c5\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") "
Oct 30 16:20:45.834224 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.833958    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token\") pod \"afdf3517-540a-470f-b111-043df8f007c5\" (UID: \"afdf3517-540a-470f-b111-043df8f007c5\") "
Oct 30 16:20:45.834224 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.834132    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates" pod "afdf3517-540a-470f-b111-043df8f007c5" (UID: "afdf3517-540a-470f-b111-043df8f007c5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:45.834224 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.834141    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca" pod "afdf3517-540a-470f-b111-043df8f007c5" (UID: "afdf3517-540a-470f-b111-043df8f007c5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:45.834426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.834225    5101 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-trusted-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:45.834426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.834243    5101 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afdf3517-540a-470f-b111-043df8f007c5-registry-certificates\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:45.836566 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.836536    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token" pod "afdf3517-540a-470f-b111-043df8f007c5" (UID: "afdf3517-540a-470f-b111-043df8f007c5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:45.836834 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.836807    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls" pod "afdf3517-540a-470f-b111-043df8f007c5" (UID: "afdf3517-540a-470f-b111-043df8f007c5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:45.836915 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.836882    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration" pod "afdf3517-540a-470f-b111-043df8f007c5" (UID: "afdf3517-540a-470f-b111-043df8f007c5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:45.837079 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.837061    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets" pod "afdf3517-540a-470f-b111-043df8f007c5" (UID: "afdf3517-540a-470f-b111-043df8f007c5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:45.837411 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.837388    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7" pod "afdf3517-540a-470f-b111-043df8f007c5" (UID: "afdf3517-540a-470f-b111-043df8f007c5"). InnerVolumeSpecName "kube-api-access-gqzz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:45.842208 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.842186    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted" pod "afdf3517-540a-470f-b111-043df8f007c5" (UID: "afdf3517-540a-470f-b111-043df8f007c5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:45.934620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.934589    5101 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-registry-tls\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:45.934620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.934615    5101 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-image-registry-private-configuration\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:45.934620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.934626    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqzz7\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-kube-api-access-gqzz7\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:45.934833 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.934636    5101 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdf3517-540a-470f-b111-043df8f007c5-bound-sa-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:45.934833 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.934645    5101 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afdf3517-540a-470f-b111-043df8f007c5-ca-trust-extracted\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:45.934833 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:45.934653    5101 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afdf3517-540a-470f-b111-043df8f007c5-installation-pull-secrets\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:46.571371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:46.571328    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869764d77-758qx"
Oct 30 16:20:46.571829 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:46.571372    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869764d77-758qx" event={"ID":"afdf3517-540a-470f-b111-043df8f007c5","Type":"ContainerDied","Data":"96df6776598c9c7cc67bff37b91e5b49c97ec3c33b16513c2940aec9c95de350"}
Oct 30 16:20:46.571829 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:46.571427    5101 scope.go:122] "RemoveContainer" containerID="5d710c5cc6525f4c5556b9eae0be8d70551b1bba260a9a3b4012c6975dd441c5"
Oct 30 16:20:46.634814 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:46.634780    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7869764d77-758qx"]
Oct 30 16:20:46.646727 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:46.646696    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7869764d77-758qx"]
Oct 30 16:20:47.076782 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.072805    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="afdf3517-540a-470f-b111-043df8f007c5" path="/var/lib/kubelet/pods/afdf3517-540a-470f-b111-043df8f007c5/volumes"
Oct 30 16:20:47.200974 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.200912    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5bcfcb56c9-x6xsn" podUID="cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" containerName="console" containerID="cri-o://6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df" gracePeriod=15
Oct 30 16:20:47.345822 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.345778    5101 patch_prober.go:29] interesting pod/console-5bcfcb56c9-x6xsn container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.30:8443/health\": dial tcp 10.132.0.30:8443: connect: connection refused" start-of-body=
Oct 30 16:20:47.345952 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.345881    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console/console-5bcfcb56c9-x6xsn" podUID="cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.30:8443/health\": dial tcp 10.132.0.30:8443: connect: connection refused"
Oct 30 16:20:47.490152 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.490124    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:20:47.547154 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547123    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-oauth-serving-cert\") pod \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") "
Oct 30 16:20:47.547154 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547156    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-serving-cert\") pod \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") "
Oct 30 16:20:47.547425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547187    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-oauth-config\") pod \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") "
Oct 30 16:20:47.547425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547248    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-service-ca\") pod \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") "
Oct 30 16:20:47.547425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547398    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-kube-api-access-jskgw\" (UniqueName: \"kubernetes.io/projected/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-kube-api-access-jskgw\") pod \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") "
Oct 30 16:20:47.547588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547467    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-tmp\") pod \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") "
Oct 30 16:20:47.547588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547500    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-config\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-config\") pod \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\" (UID: \"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d\") "
Oct 30 16:20:47.547697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547638    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-oauth-serving-cert" pod "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" (UID: "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:47.547697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547654    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-service-ca" pod "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" (UID: "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:47.547835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547762    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-tmp" pod "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" (UID: "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:47.547934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547914    5101 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-tmp\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:47.547994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547942    5101 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-oauth-serving-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:47.547994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547942    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-config" pod "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" (UID: "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:47.547994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.547958    5101 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-service-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:47.549809 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.549782    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-serving-cert" pod "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" (UID: "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:47.549896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.549801    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-oauth-config" pod "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" (UID: "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:47.549896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.549836    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-kube-api-access-jskgw" pod "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" (UID: "cc8042c2-8957-4ccb-b5cd-652cb7e95a7d"). InnerVolumeSpecName "kube-api-access-jskgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:47.577456 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.577429    5101 generic.go:356] "Generic (PLEG): container finished" podID="cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" containerID="6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df" exitCode=0
Oct 30 16:20:47.577804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.577471    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcfcb56c9-x6xsn" event={"ID":"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d","Type":"ContainerDied","Data":"6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df"}
Oct 30 16:20:47.577804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.577486    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcfcb56c9-x6xsn"
Oct 30 16:20:47.577804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.577515    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcfcb56c9-x6xsn" event={"ID":"cc8042c2-8957-4ccb-b5cd-652cb7e95a7d","Type":"ContainerDied","Data":"d928f2b56888e3f8ef768c9fa0f6ef0d93b7679f9d36f1486db7ae8346e73eef"}
Oct 30 16:20:47.577804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.577535    5101 scope.go:122] "RemoveContainer" containerID="6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df"
Oct 30 16:20:47.585934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.585916    5101 scope.go:122] "RemoveContainer" containerID="6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df"
Oct 30 16:20:47.586236 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:20:47.586215    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df\": container with ID starting with 6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df not found: ID does not exist" containerID="6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df"
Oct 30 16:20:47.586292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.586245    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df"} err="failed to get container status \"6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df\": rpc error: code = NotFound desc = could not find container \"6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df\": container with ID starting with 6ad9b97cbbdc6bbcb95346957b7eded945154d29578ab48a6e9157f60855d4df not found: ID does not exist"
Oct 30 16:20:47.627654 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.627590    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bcfcb56c9-x6xsn"]
Oct 30 16:20:47.631950 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.631928    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bcfcb56c9-x6xsn"]
Oct 30 16:20:47.648908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.648887    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jskgw\" (UniqueName: \"kubernetes.io/projected/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-kube-api-access-jskgw\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:47.649002 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.648909    5101 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-config\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:47.649002 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.648921    5101 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-serving-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:47.649002 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:47.648929    5101 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d-console-oauth-config\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:20:48.875384 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:48.875328    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:49.037746 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:49.037702    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:49.072544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:49.072513    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" path="/var/lib/kubelet/pods/cc8042c2-8957-4ccb-b5cd-652cb7e95a7d/volumes"
Oct 30 16:20:50.291423 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:20:50.291385    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:20:53.366145 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:53.366094    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:53.505269 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:53.505237    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:53.649059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:53.649011    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:53.800887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:53.800849    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:53.951606 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:53.951524    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:20:56.617352 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:56.617316    5101 generic.go:356] "Generic (PLEG): container finished" podID="659d22c7-e8bf-48e3-a6e8-54f4e2e77cea" containerID="bd1da19b87e65f8a6ca732bacbb530cf3c183c8a78800acad0725347d6a9b3cd" exitCode=0
Oct 30 16:20:56.617727 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:56.617394    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8" event={"ID":"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea","Type":"ContainerDied","Data":"bd1da19b87e65f8a6ca732bacbb530cf3c183c8a78800acad0725347d6a9b3cd"}
Oct 30 16:20:56.617727 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:56.617721    5101 scope.go:122] "RemoveContainer" containerID="bd1da19b87e65f8a6ca732bacbb530cf3c183c8a78800acad0725347d6a9b3cd"
Oct 30 16:20:57.623625 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:20:57.623589    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p7jv8" event={"ID":"659d22c7-e8bf-48e3-a6e8-54f4e2e77cea","Type":"ContainerStarted","Data":"1be66b9c069a235a8c04435e439c7f5c2e3183aca752b70b2c97a5467b3cc528"}
Oct 30 16:21:02.948962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:02.948929    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:03.100893 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:03.100860    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:03.249666 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:03.249588    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:09.221324 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:09.221293    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:09.390384 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:09.390318    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:09.584629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:09.584533    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:09.728321 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:09.728289    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:09.872110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:09.872022    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:12.826906 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:12.826873    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:12.970072 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:12.970034    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:20.290756 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:21:20.290717    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:21:23.638007 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:23.637977    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:23.838852 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:23.838819    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:30.948654 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:21:30.948619    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:21:50.290358 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:21:50.290312    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:22:20.291148 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:22:20.291066    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:22:31.039659 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:22:31.039619    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:22:50.290488 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:22:50.290450    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:23:20.290222 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:23:20.290186    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:23:31.113792 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:23:31.113709    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:23:31.264467 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:23:31.264430    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:23:39.042536 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:23:39.042466    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:23:39.199910 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:23:39.199876    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:23:50.290416 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:23:50.290377    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:23:54.797737 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:23:54.797701    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:23:54.964704 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:23:54.964674    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:01.103831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:01.103682    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:02.526678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:02.526644    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:04.314233 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:04.314199    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:04.456822 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:04.456792    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:06.634620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:06.634591    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:06.859241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:06.859209    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:09.024215 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:09.024186    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:09.437694 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:09.437661    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:11.504200 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:11.504161    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:11.653228 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:11.653192    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:16.051861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:16.051832    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:16.196687 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:16.196650    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:16.360375 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:16.360271    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:20.290182 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:24:20.290147    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:24:23.323401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:23.323369    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:23.470199 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:23.470167    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:31.305321 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:31.305292    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:32.385520 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:32.385488    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:32.536988 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:32.536955    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:34.063696 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:34.063659    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:38.333398 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:38.333364    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:38.481349 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:38.481317    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:41.100591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:41.100553    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:24:41.101016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:41.100554    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:24:41.104198 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:41.104177    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:24:41.104323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:41.104200    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:24:41.250517 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:41.250487    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:41.395794 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:41.395763    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:41.783792 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:41.783715    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:44.401638 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.401605    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:44.499254 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499214    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"]
Oct 30 16:24:44.499613 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499595    5101 cpu_manager.go:414] "containerMap: removing container" podUID="b56e3d45-f38f-408d-bc5e-de16f6de4da6" containerName="insights-gathering"
Oct 30 16:24:44.499700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499615    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b56e3d45-f38f-408d-bc5e-de16f6de4da6" containerName="insights-gathering"
Oct 30 16:24:44.499700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499632    5101 cpu_manager.go:414] "containerMap: removing container" podUID="afdf3517-540a-470f-b111-043df8f007c5" containerName="registry"
Oct 30 16:24:44.499700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499638    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="afdf3517-540a-470f-b111-043df8f007c5" containerName="registry"
Oct 30 16:24:44.499700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499658    5101 cpu_manager.go:414] "containerMap: removing container" podUID="548f7cd0-4adf-403f-b879-fb8be191d374" containerName="insights-gathering"
Oct 30 16:24:44.499700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499667    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="548f7cd0-4adf-403f-b879-fb8be191d374" containerName="insights-gathering"
Oct 30 16:24:44.499700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499687    5101 cpu_manager.go:414] "containerMap: removing container" podUID="4b6aeef2-7878-466d-964c-2a375bdb8f04" containerName="registry"
Oct 30 16:24:44.499700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499694    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b6aeef2-7878-466d-964c-2a375bdb8f04" containerName="registry"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499708    5101 cpu_manager.go:414] "containerMap: removing container" podUID="cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" containerName="console"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499715    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" containerName="console"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499724    5101 cpu_manager.go:414] "containerMap: removing container" podUID="69cabfed-c191-4934-8d75-d619653bf44b" containerName="console"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499731    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69cabfed-c191-4934-8d75-d619653bf44b" containerName="console"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499825    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b6aeef2-7878-466d-964c-2a375bdb8f04" containerName="registry"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499836    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc8042c2-8957-4ccb-b5cd-652cb7e95a7d" containerName="console"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499846    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="69cabfed-c191-4934-8d75-d619653bf44b" containerName="console"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499858    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="b56e3d45-f38f-408d-bc5e-de16f6de4da6" containerName="insights-gathering"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499866    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="afdf3517-540a-470f-b111-043df8f007c5" containerName="registry"
Oct 30 16:24:44.500019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.499877    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="548f7cd0-4adf-403f-b879-fb8be191d374" containerName="insights-gathering"
Oct 30 16:24:44.502881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.502861    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.538591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.538566    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"]
Oct 30 16:24:44.571760 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.571738    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-metrics-cert\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.571894 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.571778    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67wsg\" (UniqueName: \"kubernetes.io/projected/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-kube-api-access-67wsg\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.571894 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.571801    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-manager-config\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.571894 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.571846    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-cert\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.600580 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.600554    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Oct 30 16:24:44.600778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.600763    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Oct 30 16:24:44.600838 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.600781    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Oct 30 16:24:44.600838 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.600829    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mmvfj\""
Oct 30 16:24:44.600912 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.600875    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:24:44.600956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.600945    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Oct 30 16:24:44.646500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.646477    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:44.672711 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.672665    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-metrics-cert\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.672711 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.672707    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67wsg\" (UniqueName: \"kubernetes.io/projected/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-kube-api-access-67wsg\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.672871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.672729    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-manager-config\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.672871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.672752    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-cert\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.673512 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.673476    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-manager-config\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.675351 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.675308    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-metrics-cert\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.675683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.675665    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-cert\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.696550 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.696525    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67wsg\" (UniqueName: \"kubernetes.io/projected/6023081d-aae1-4c1b-bed6-5531ce5c3d6c-kube-api-access-67wsg\") pod \"lws-controller-manager-57f6876db8-c7qx6\" (UID: \"6023081d-aae1-4c1b-bed6-5531ce5c3d6c\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:44.813967 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:44.813942    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:45.108587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:45.108562    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"]
Oct 30 16:24:45.109773 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:24:45.109752    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6023081d_aae1_4c1b_bed6_5531ce5c3d6c.slice/crio-55804e552d0f2ded5827b09ec46c4bc77f1b61f86692d30661a0417053fda3a6 WatchSource:0}: Error finding container 55804e552d0f2ded5827b09ec46c4bc77f1b61f86692d30661a0417053fda3a6: Status 404 returned error can't find the container with id 55804e552d0f2ded5827b09ec46c4bc77f1b61f86692d30661a0417053fda3a6
Oct 30 16:24:45.112017 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:45.111997    5101 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:24:45.523268 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:45.523232    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6" event={"ID":"6023081d-aae1-4c1b-bed6-5531ce5c3d6c","Type":"ContainerStarted","Data":"55804e552d0f2ded5827b09ec46c4bc77f1b61f86692d30661a0417053fda3a6"}
Oct 30 16:24:48.541989 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:48.541953    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6" event={"ID":"6023081d-aae1-4c1b-bed6-5531ce5c3d6c","Type":"ContainerStarted","Data":"7ed47dd4cdf92d1207ccb7f81eb8817b93b8e96805f9c8eaee60223ba3244441"}
Oct 30 16:24:48.542559 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:48.542075    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:24:48.584401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:48.584359    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6" podStartSLOduration=2.136598075 podStartE2EDuration="4.584329728s" totalImagesPullingTime="2.447731653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:24:48.583768042 +0000 UTC m=+307.637045665" watchObservedRunningTime="2026-10-30 16:24:48.584329728 +0000 UTC m=+307.637607337"
Oct 30 16:24:50.290220 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:24:50.290185    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:24:51.174701 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:51.174651    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:51.327203 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:51.327174    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:51.816761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:51.816729    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:51.961062 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:51.961027    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"]
Oct 30 16:24:51.964603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:51.964583    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:51.996946 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:51.996919    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"]
Oct 30 16:24:52.035642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.035608    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/397f5512-9211-4179-94d9-41964e7decd8-manifests\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.035642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.035640    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-webhook-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.035902 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.035678    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lphbm\" (UniqueName: \"kubernetes.io/projected/397f5512-9211-4179-94d9-41964e7decd8-kube-api-access-lphbm\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.035902 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.035777    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/397f5512-9211-4179-94d9-41964e7decd8-tmp\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.035902 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.035830    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.036005 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.035946    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-metrics-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.038148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.038067    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:52.049251 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.049229    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 16:24:52.049419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.049404    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 16:24:52.050896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.050878    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 16:24:52.051001 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.050928    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7jncl\""
Oct 30 16:24:52.051001 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.050928    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 16:24:52.051109 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.051046    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\""
Oct 30 16:24:52.136902 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.136818    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.136902 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.136882    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-metrics-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.137126 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.136929    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/397f5512-9211-4179-94d9-41964e7decd8-manifests\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.137126 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.136956    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-webhook-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.137126 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.136988    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lphbm\" (UniqueName: \"kubernetes.io/projected/397f5512-9211-4179-94d9-41964e7decd8-kube-api-access-lphbm\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.137126 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.137020    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/397f5512-9211-4179-94d9-41964e7decd8-tmp\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.137697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.137671    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/397f5512-9211-4179-94d9-41964e7decd8-manifests\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.139393 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.139367    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/397f5512-9211-4179-94d9-41964e7decd8-tmp\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.139594 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.139575    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-webhook-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.139637 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.139591    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.139670 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.139653    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/397f5512-9211-4179-94d9-41964e7decd8-metrics-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.161785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.161754    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lphbm\" (UniqueName: \"kubernetes.io/projected/397f5512-9211-4179-94d9-41964e7decd8-kube-api-access-lphbm\") pod \"opendatahub-operator-controller-manager-8dcb75f99-z6bt4\" (UID: \"397f5512-9211-4179-94d9-41964e7decd8\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.178832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.178805    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:52.279261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.279228    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:52.420680 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.420651    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:52.594180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.594149    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:24:52.634364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:52.634325    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"]
Oct 30 16:24:52.635419 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:24:52.635395    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397f5512_9211_4179_94d9_41964e7decd8.slice/crio-9ee8733ed8b8109b17f8411fa85d457c0e541e0eb7469d310309fe8b86617199 WatchSource:0}: Error finding container 9ee8733ed8b8109b17f8411fa85d457c0e541e0eb7469d310309fe8b86617199: Status 404 returned error can't find the container with id 9ee8733ed8b8109b17f8411fa85d457c0e541e0eb7469d310309fe8b86617199
Oct 30 16:24:53.565925 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:53.565842    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4" event={"ID":"397f5512-9211-4179-94d9-41964e7decd8","Type":"ContainerStarted","Data":"9ee8733ed8b8109b17f8411fa85d457c0e541e0eb7469d310309fe8b86617199"}
Oct 30 16:24:55.576423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:55.576329    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4" event={"ID":"397f5512-9211-4179-94d9-41964e7decd8","Type":"ContainerStarted","Data":"43303c411363eb56abc469b2b89303c437c640384a3cd022b1e5a936bd4c9cc5"}
Oct 30 16:24:56.581620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:56.581590    5101 generic.go:356] "Generic (PLEG): container finished" podID="397f5512-9211-4179-94d9-41964e7decd8" containerID="43303c411363eb56abc469b2b89303c437c640384a3cd022b1e5a936bd4c9cc5" exitCode=0
Oct 30 16:24:56.581983 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:56.581666    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4" event={"ID":"397f5512-9211-4179-94d9-41964e7decd8","Type":"ContainerDied","Data":"43303c411363eb56abc469b2b89303c437c640384a3cd022b1e5a936bd4c9cc5"}
Oct 30 16:24:57.587899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:57.587858    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4" event={"ID":"397f5512-9211-4179-94d9-41964e7decd8","Type":"ContainerStarted","Data":"9144d1cc2eaabe871e30cc352271838355029e03ae1f6f58cb1205a4cda00c01"}
Oct 30 16:24:57.588277 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:57.588010    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:24:57.677036 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:57.676985    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4" podStartSLOduration=3.21823532 podStartE2EDuration="6.676967125s" totalImagesPullingTime="2.995948996s" totalInitContainerRuntime="462.782809ms" isStatefulPod=false podCreationTimestamp="2026-10-30 16:24:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:24:57.663427232 +0000 UTC m=+316.716704842" watchObservedRunningTime="2026-10-30 16:24:57.676967125 +0000 UTC m=+316.730244738"
Oct 30 16:24:59.549470 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:24:59.549439    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-c7qx6"
Oct 30 16:25:08.594231 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:08.594202    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-z6bt4"
Oct 30 16:25:08.997447 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:08.997398    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:09.181286 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:09.181254    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:11.530482 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:11.530448    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:11.680189 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:11.680151    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:12.094490 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:12.094450    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:12.267217 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:12.267186    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:13.885474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:13.885432    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:14.048696 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:14.048656    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:15.346844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.346805    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:15.498692 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.498658    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:15.685387 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.685360    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-observability-584f99c788-ns26f"]
Oct 30 16:25:15.694169 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.694147    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:15.708863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.708837    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-observability-584f99c788-ns26f"]
Oct 30 16:25:15.720141 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.720122    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-observability-webhook-cert\""
Oct 30 16:25:15.720232 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.720152    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-observability-dockercfg-wlgk4\""
Oct 30 16:25:15.774370 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.774325    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:15.834797 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.834773    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cac2e745-b65e-4bce-965d-e673223ee10a-webhook-certs\") pod \"odh-observability-584f99c788-ns26f\" (UID: \"cac2e745-b65e-4bce-965d-e673223ee10a\") " pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:15.834901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.834823    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wzzf\" (UniqueName: \"kubernetes.io/projected/cac2e745-b65e-4bce-965d-e673223ee10a-kube-api-access-5wzzf\") pod \"odh-observability-584f99c788-ns26f\" (UID: \"cac2e745-b65e-4bce-965d-e673223ee10a\") " pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:15.936246 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.936183    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cac2e745-b65e-4bce-965d-e673223ee10a-webhook-certs\") pod \"odh-observability-584f99c788-ns26f\" (UID: \"cac2e745-b65e-4bce-965d-e673223ee10a\") " pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:15.936246 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.936231    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzzf\" (UniqueName: \"kubernetes.io/projected/cac2e745-b65e-4bce-965d-e673223ee10a-kube-api-access-5wzzf\") pod \"odh-observability-584f99c788-ns26f\" (UID: \"cac2e745-b65e-4bce-965d-e673223ee10a\") " pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:15.936407 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:25:15.936318    5101 secret.go:189] Couldn't get secret opendatahub/odh-observability-webhook-cert: secret "odh-observability-webhook-cert" not found
Oct 30 16:25:15.936442 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:25:15.936409    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cac2e745-b65e-4bce-965d-e673223ee10a-webhook-certs podName:cac2e745-b65e-4bce-965d-e673223ee10a nodeName:}" failed. No retries permitted until 2026-10-30 16:25:16.436393756 +0000 UTC m=+335.489671344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/cac2e745-b65e-4bce-965d-e673223ee10a-webhook-certs") pod "odh-observability-584f99c788-ns26f" (UID: "cac2e745-b65e-4bce-965d-e673223ee10a") : secret "odh-observability-webhook-cert" not found
Oct 30 16:25:15.962227 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:15.962198    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wzzf\" (UniqueName: \"kubernetes.io/projected/cac2e745-b65e-4bce-965d-e673223ee10a-kube-api-access-5wzzf\") pod \"odh-observability-584f99c788-ns26f\" (UID: \"cac2e745-b65e-4bce-965d-e673223ee10a\") " pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:16.149245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:16.149216    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:16.439849 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:16.439815    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cac2e745-b65e-4bce-965d-e673223ee10a-webhook-certs\") pod \"odh-observability-584f99c788-ns26f\" (UID: \"cac2e745-b65e-4bce-965d-e673223ee10a\") " pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:16.442198 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:16.442170    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cac2e745-b65e-4bce-965d-e673223ee10a-webhook-certs\") pod \"odh-observability-584f99c788-ns26f\" (UID: \"cac2e745-b65e-4bce-965d-e673223ee10a\") " pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:16.608795 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:16.608756    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:16.900986 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:16.900954    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-observability-584f99c788-ns26f"]
Oct 30 16:25:16.902287 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:25:16.902262    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac2e745_b65e_4bce_965d_e673223ee10a.slice/crio-e8e8cd0f0ef76dbea4a9083a79770674703440324a9f9cdc056c0321eec93742 WatchSource:0}: Error finding container e8e8cd0f0ef76dbea4a9083a79770674703440324a9f9cdc056c0321eec93742: Status 404 returned error can't find the container with id e8e8cd0f0ef76dbea4a9083a79770674703440324a9f9cdc056c0321eec93742
Oct 30 16:25:17.676813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:17.676779    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-observability-584f99c788-ns26f" event={"ID":"cac2e745-b65e-4bce-965d-e673223ee10a","Type":"ContainerStarted","Data":"e8e8cd0f0ef76dbea4a9083a79770674703440324a9f9cdc056c0321eec93742"}
Oct 30 16:25:17.891407 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:17.891376    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:18.038422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:18.038330    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:18.759461 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:18.759425    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:18.910127 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:18.910094    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:19.198430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:19.198390    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:20.290647 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:25:20.290601    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:25:20.693050 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:20.693020    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-observability-584f99c788-ns26f" event={"ID":"cac2e745-b65e-4bce-965d-e673223ee10a","Type":"ContainerStarted","Data":"cfb8c2a882f696a7f029f3667340cd21cf107f6712edb8139ed3a52ebba74181"}
Oct 30 16:25:20.693207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:20.693112    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:20.735129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:20.735085    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-observability-584f99c788-ns26f" podStartSLOduration=2.994234202 podStartE2EDuration="5.73506987s" totalImagesPullingTime="2.740835668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:25:20.733906168 +0000 UTC m=+339.787183781" watchObservedRunningTime="2026-10-30 16:25:20.73506987 +0000 UTC m=+339.788347481"
Oct 30 16:25:29.918944 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:29.918911    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:29.937248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:29.937220    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"]
Oct 30 16:25:29.940944 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:29.940925    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:29.958486 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:29.958464    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-2bg48\""
Oct 30 16:25:29.996597 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:29.996565    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 16:25:29.997905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:29.997888    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"]
Oct 30 16:25:30.042239 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.042210    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-tmp\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.042376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.042251    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-manifests\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.042376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.042366    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txk2t\" (UniqueName: \"kubernetes.io/projected/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-kube-api-access-txk2t\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.042446 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.042397    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-trusted-ca\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.095364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.095318    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:30.143642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.143612    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-trusted-ca\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.143768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.143684    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-tmp\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.143768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.143761    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-manifests\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.143875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.143810    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txk2t\" (UniqueName: \"kubernetes.io/projected/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-kube-api-access-txk2t\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.144171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.144146    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-tmp\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.144242 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.144157    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-manifests\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.144580 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.144562    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-trusted-ca\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.167635 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.167611    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txk2t\" (UniqueName: \"kubernetes.io/projected/e2bfb1be-3e8d-465b-aa2e-72b09dd25769-kube-api-access-txk2t\") pod \"kserve-module-controller-manager-5cfb77bf8c-7gcfx\" (UID: \"e2bfb1be-3e8d-465b-aa2e-72b09dd25769\") " pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.253004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.252946    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:30.564232 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.564207    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"]
Oct 30 16:25:30.565189 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:25:30.565164    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bfb1be_3e8d_465b_aa2e_72b09dd25769.slice/crio-17fe43d124c10e5bd4e61ee0a929d26b413192eb2120944927d25bab4694c1bb WatchSource:0}: Error finding container 17fe43d124c10e5bd4e61ee0a929d26b413192eb2120944927d25bab4694c1bb: Status 404 returned error can't find the container with id 17fe43d124c10e5bd4e61ee0a929d26b413192eb2120944927d25bab4694c1bb
Oct 30 16:25:30.734062 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:30.734025    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx" event={"ID":"e2bfb1be-3e8d-465b-aa2e-72b09dd25769","Type":"ContainerStarted","Data":"17fe43d124c10e5bd4e61ee0a929d26b413192eb2120944927d25bab4694c1bb"}
Oct 30 16:25:31.420776 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:31.420727    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:25:31.701544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:31.701467    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-observability-584f99c788-ns26f"
Oct 30 16:25:33.748190 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:33.748153    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx" event={"ID":"e2bfb1be-3e8d-465b-aa2e-72b09dd25769","Type":"ContainerStarted","Data":"08cfc36bf239d6d5aaf96d8dd952c706c24a39d6459102d1a281cdf410259f22"}
Oct 30 16:25:33.748607 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:33.748301    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:25:33.803909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:33.803851    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx" podStartSLOduration=2.575257006 podStartE2EDuration="4.803830893s" totalImagesPullingTime="2.228573887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:25:33.803506157 +0000 UTC m=+352.856783763" watchObservedRunningTime="2026-10-30 16:25:33.803830893 +0000 UTC m=+352.857108503"
Oct 30 16:25:50.290351 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:25:50.290299    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:25:54.760840 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:25:54.760804    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-5cfb77bf8c-7gcfx"
Oct 30 16:26:16.477900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:16.477868    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:17.428916 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.428880    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:17.607613 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.607580    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:17.630648 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.630620    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-k9cjs"]
Oct 30 16:26:17.642390 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.642368    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:17.655560 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.655530    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-k9cjs"]
Oct 30 16:26:17.665969 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.665947    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 16:26:17.665969 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.665959    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-q6bgj\""
Oct 30 16:26:17.709905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.709844    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-tth4z"]
Oct 30 16:26:17.715283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.715266    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:17.732719 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.732699    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-tth4z"]
Oct 30 16:26:17.743539 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.743518    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da7fbd30-e3e6-40a9-af14-b85ecf366d22-cert\") pod \"kserve-controller-manager-776cc66d47-k9cjs\" (UID: \"da7fbd30-e3e6-40a9-af14-b85ecf366d22\") " pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:17.743647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.743628    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phczr\" (UniqueName: \"kubernetes.io/projected/da7fbd30-e3e6-40a9-af14-b85ecf366d22-kube-api-access-phczr\") pod \"kserve-controller-manager-776cc66d47-k9cjs\" (UID: \"da7fbd30-e3e6-40a9-af14-b85ecf366d22\") " pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:17.754552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.754530    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-l7pr2"]
Oct 30 16:26:17.757809 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.757791    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.772300 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.772283    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:17.779030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.779000    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-l7pr2"]
Oct 30 16:26:17.799557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.799526    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 16:26:17.799557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.799527    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 30 16:26:17.799764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.799527    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bgl2p\""
Oct 30 16:26:17.799764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.799555    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 16:26:17.799764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.799603    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tqpg9\""
Oct 30 16:26:17.844259 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.844231    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f125229-9356-4897-99e3-3271fe7067eb-metrics-certs\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.844259 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.844261    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f125229-9356-4897-99e3-3271fe7067eb-cert\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.844458 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.844291    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phczr\" (UniqueName: \"kubernetes.io/projected/da7fbd30-e3e6-40a9-af14-b85ecf366d22-kube-api-access-phczr\") pod \"kserve-controller-manager-776cc66d47-k9cjs\" (UID: \"da7fbd30-e3e6-40a9-af14-b85ecf366d22\") " pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:17.844458 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.844448    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbnp\" (UniqueName: \"kubernetes.io/projected/3a6aeb34-902a-4c3e-b276-01b9a329fab9-kube-api-access-zsbnp\") pod \"model-serving-api-75bd89fdfc-tth4z\" (UID: \"3a6aeb34-902a-4c3e-b276-01b9a329fab9\") " pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:17.844565 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.844516    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p27d\" (UniqueName: \"kubernetes.io/projected/3f125229-9356-4897-99e3-3271fe7067eb-kube-api-access-5p27d\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.844620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.844582    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da7fbd30-e3e6-40a9-af14-b85ecf366d22-cert\") pod \"kserve-controller-manager-776cc66d47-k9cjs\" (UID: \"da7fbd30-e3e6-40a9-af14-b85ecf366d22\") " pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:17.844674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.844657    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6aeb34-902a-4c3e-b276-01b9a329fab9-tls-certs\") pod \"model-serving-api-75bd89fdfc-tth4z\" (UID: \"3a6aeb34-902a-4c3e-b276-01b9a329fab9\") " pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:17.846940 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.846912    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da7fbd30-e3e6-40a9-af14-b85ecf366d22-cert\") pod \"kserve-controller-manager-776cc66d47-k9cjs\" (UID: \"da7fbd30-e3e6-40a9-af14-b85ecf366d22\") " pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:17.869408 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.869389    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phczr\" (UniqueName: \"kubernetes.io/projected/da7fbd30-e3e6-40a9-af14-b85ecf366d22-kube-api-access-phczr\") pod \"kserve-controller-manager-776cc66d47-k9cjs\" (UID: \"da7fbd30-e3e6-40a9-af14-b85ecf366d22\") " pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:17.924040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.924005    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:17.945917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.945892    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6aeb34-902a-4c3e-b276-01b9a329fab9-tls-certs\") pod \"model-serving-api-75bd89fdfc-tth4z\" (UID: \"3a6aeb34-902a-4c3e-b276-01b9a329fab9\") " pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:17.946049 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.945938    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f125229-9356-4897-99e3-3271fe7067eb-metrics-certs\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.946049 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.945964    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f125229-9356-4897-99e3-3271fe7067eb-cert\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.946049 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.946021    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbnp\" (UniqueName: \"kubernetes.io/projected/3a6aeb34-902a-4c3e-b276-01b9a329fab9-kube-api-access-zsbnp\") pod \"model-serving-api-75bd89fdfc-tth4z\" (UID: \"3a6aeb34-902a-4c3e-b276-01b9a329fab9\") " pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:17.946049 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.946044    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p27d\" (UniqueName: \"kubernetes.io/projected/3f125229-9356-4897-99e3-3271fe7067eb-kube-api-access-5p27d\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.948463 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.948437    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f125229-9356-4897-99e3-3271fe7067eb-metrics-certs\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.948555 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.948483    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f125229-9356-4897-99e3-3271fe7067eb-cert\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.948555 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.948544    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6aeb34-902a-4c3e-b276-01b9a329fab9-tls-certs\") pod \"model-serving-api-75bd89fdfc-tth4z\" (UID: \"3a6aeb34-902a-4c3e-b276-01b9a329fab9\") " pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:17.956386 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.956364    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:17.971534 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.971511    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p27d\" (UniqueName: \"kubernetes.io/projected/3f125229-9356-4897-99e3-3271fe7067eb-kube-api-access-5p27d\") pod \"odh-model-controller-f87fcf56c-l7pr2\" (UID: \"3f125229-9356-4897-99e3-3271fe7067eb\") " pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:17.971534 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:17.971520    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbnp\" (UniqueName: \"kubernetes.io/projected/3a6aeb34-902a-4c3e-b276-01b9a329fab9-kube-api-access-zsbnp\") pod \"model-serving-api-75bd89fdfc-tth4z\" (UID: \"3a6aeb34-902a-4c3e-b276-01b9a329fab9\") " pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:18.028391 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.027899    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:18.070104 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.070063    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:18.145358 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.145312    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:18.251417 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.251388    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-k9cjs"]
Oct 30 16:26:18.252276 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:26:18.252253    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7fbd30_e3e6_40a9_af14_b85ecf366d22.slice/crio-698d0f19b866251e14426214bd8378fc1cb0e3364b2aa9776b4f3446fc9f25b2 WatchSource:0}: Error finding container 698d0f19b866251e14426214bd8378fc1cb0e3364b2aa9776b4f3446fc9f25b2: Status 404 returned error can't find the container with id 698d0f19b866251e14426214bd8378fc1cb0e3364b2aa9776b4f3446fc9f25b2
Oct 30 16:26:18.326228 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.326206    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-tth4z"]
Oct 30 16:26:18.327013 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:26:18.326984    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6aeb34_902a_4c3e_b276_01b9a329fab9.slice/crio-83a74f19af0c4093effee7e0a0f1abd733b5645152a3979c1c4e55a18a9fe3d6 WatchSource:0}: Error finding container 83a74f19af0c4093effee7e0a0f1abd733b5645152a3979c1c4e55a18a9fe3d6: Status 404 returned error can't find the container with id 83a74f19af0c4093effee7e0a0f1abd733b5645152a3979c1c4e55a18a9fe3d6
Oct 30 16:26:18.372489 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.372462    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-l7pr2"]
Oct 30 16:26:18.373565 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:26:18.373542    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f125229_9356_4897_99e3_3271fe7067eb.slice/crio-2829da30fa85b973403a4bb22e88a203a3be3ae68f123bbce02e676dc0e4a40a WatchSource:0}: Error finding container 2829da30fa85b973403a4bb22e88a203a3be3ae68f123bbce02e676dc0e4a40a: Status 404 returned error can't find the container with id 2829da30fa85b973403a4bb22e88a203a3be3ae68f123bbce02e676dc0e4a40a
Oct 30 16:26:18.938191 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.938096    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2" event={"ID":"3f125229-9356-4897-99e3-3271fe7067eb","Type":"ContainerStarted","Data":"2829da30fa85b973403a4bb22e88a203a3be3ae68f123bbce02e676dc0e4a40a"}
Oct 30 16:26:18.940271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.940240    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-tth4z" event={"ID":"3a6aeb34-902a-4c3e-b276-01b9a329fab9","Type":"ContainerStarted","Data":"83a74f19af0c4093effee7e0a0f1abd733b5645152a3979c1c4e55a18a9fe3d6"}
Oct 30 16:26:18.942729 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:18.942666    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs" event={"ID":"da7fbd30-e3e6-40a9-af14-b85ecf366d22","Type":"ContainerStarted","Data":"698d0f19b866251e14426214bd8378fc1cb0e3364b2aa9776b4f3446fc9f25b2"}
Oct 30 16:26:20.014569 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:20.014532    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:20.164401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:20.164364    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:20.302892 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:26:20.302785    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:26:20.313713 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:20.313678    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:20.465684 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:20.465264    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:20.955878 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:20.955844    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-tth4z" event={"ID":"3a6aeb34-902a-4c3e-b276-01b9a329fab9","Type":"ContainerStarted","Data":"de0cd30350b2a5762cf5ba86edcab34889c26e40f982265e907ac55fbfaa4d83"}
Oct 30 16:26:20.956002 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:20.955972    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:20.998095 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:20.998051    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-tth4z" podStartSLOduration=1.925236076 podStartE2EDuration="3.998038693s" totalImagesPullingTime="2.072802617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:26:20.99694791 +0000 UTC m=+400.050225521" watchObservedRunningTime="2026-10-30 16:26:20.998038693 +0000 UTC m=+400.051316302"
Oct 30 16:26:21.961371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:21.961324    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2" event={"ID":"3f125229-9356-4897-99e3-3271fe7067eb","Type":"ContainerStarted","Data":"c8d48c3453caf00cc49a29fb04b642e570c556bf9d0b21ae19beacaa73ce082d"}
Oct 30 16:26:21.961840 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:21.961445    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:21.962925 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:21.962904    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs" event={"ID":"da7fbd30-e3e6-40a9-af14-b85ecf366d22","Type":"ContainerStarted","Data":"ea343093efdb5f13db9ef401545ff54d9bdb7a34193a7e9d7953182ba229d843"}
Oct 30 16:26:22.002962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:22.002921    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2" podStartSLOduration=2.075429614 podStartE2EDuration="5.00291126s" totalImagesPullingTime="2.927481646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:26:22.002647301 +0000 UTC m=+401.055924922" watchObservedRunningTime="2026-10-30 16:26:22.00291126 +0000 UTC m=+401.056188870"
Oct 30 16:26:22.044366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:22.044312    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs" podStartSLOduration=2.380371051 podStartE2EDuration="5.044300922s" totalImagesPullingTime="2.663929871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:26:22.044109944 +0000 UTC m=+401.097387553" watchObservedRunningTime="2026-10-30 16:26:22.044300922 +0000 UTC m=+401.097578531"
Oct 30 16:26:22.966997 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:22.966959    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:26:31.550044 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:31.550003    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:31.967502 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:31.967475    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-tth4z"
Oct 30 16:26:32.969260 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:32.969233    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-f87fcf56c-l7pr2"
Oct 30 16:26:39.318580 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:39.318538    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:39.471318 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:39.471285    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:26:50.289590 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:26:50.289554    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:26:53.976188 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:26:53.976155    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-k9cjs"
Oct 30 16:27:05.035174 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:05.035138    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:05.190092 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:05.190042    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:20.291536 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:27:20.291499    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:27:31.762720 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:31.762686    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:34.959275 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:34.959244    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:39.105406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:39.105373    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:41.760916 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:41.760883    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:42.453619 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:42.453579    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:42.962457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:42.962422    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:44.908713 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:44.908682    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:45.975292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:45.975261    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:46.228042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:46.227957    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:46.565569 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:46.565483    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:46.807614 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:46.807581    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:46.990093 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:46.990065    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:47.174857 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:47.174812    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:47.927599 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:47.927567    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:48.085895 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:48.085865    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:50.290458 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:27:50.290423    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:27:51.432884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:51.432849    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:51.585505 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:51.585476    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:54.622831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:54.622760    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:54.780475 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:54.780439    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:57.332689 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.332646    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"]
Oct 30 16:27:57.336507 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.336490    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.352571 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.352549    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Oct 30 16:27:57.354555 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.354534    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"]
Oct 30 16:27:57.364680 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.364654    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j4w26\""
Oct 30 16:27:57.364680 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.364675    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Oct 30 16:27:57.364811 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.364669    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 16:27:57.364811 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.364697    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 16:27:57.390884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.390859    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:57.397357 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.397321    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5778148-43bf-4e27-8b3a-968348a81718-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.397455 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.397379    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5778148-43bf-4e27-8b3a-968348a81718-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.397504 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.397478    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg857\" (UniqueName: \"kubernetes.io/projected/e5778148-43bf-4e27-8b3a-968348a81718-kube-api-access-xg857\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.498401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.498371    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg857\" (UniqueName: \"kubernetes.io/projected/e5778148-43bf-4e27-8b3a-968348a81718-kube-api-access-xg857\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.498525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.498434    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5778148-43bf-4e27-8b3a-968348a81718-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.498525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.498476    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5778148-43bf-4e27-8b3a-968348a81718-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.499094 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.499073    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5778148-43bf-4e27-8b3a-968348a81718-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.500711 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.500692    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5778148-43bf-4e27-8b3a-968348a81718-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.521448 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.521423    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg857\" (UniqueName: \"kubernetes.io/projected/e5778148-43bf-4e27-8b3a-968348a81718-kube-api-access-xg857\") pod \"kuadrant-console-plugin-66c4fb575d-wb4sl\" (UID: \"e5778148-43bf-4e27-8b3a-968348a81718\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.537399 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.537373    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:57.665360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.665314    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"
Oct 30 16:27:57.961129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:57.961105    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl"]
Oct 30 16:27:57.962652 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:27:57.962624    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5778148_43bf_4e27_8b3a_968348a81718.slice/crio-e1933f9dd79b17f67c15794d127e7b8aee6cb2d00dcc71c38a79648b2063848e WatchSource:0}: Error finding container e1933f9dd79b17f67c15794d127e7b8aee6cb2d00dcc71c38a79648b2063848e: Status 404 returned error can't find the container with id e1933f9dd79b17f67c15794d127e7b8aee6cb2d00dcc71c38a79648b2063848e
Oct 30 16:27:58.377405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:58.377310    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl" event={"ID":"e5778148-43bf-4e27-8b3a-968348a81718","Type":"ContainerStarted","Data":"e1933f9dd79b17f67c15794d127e7b8aee6cb2d00dcc71c38a79648b2063848e"}
Oct 30 16:27:59.030180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:59.030099    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:27:59.174269 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:27:59.174228    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:03.404060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:03.404022    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl" event={"ID":"e5778148-43bf-4e27-8b3a-968348a81718","Type":"ContainerStarted","Data":"2a3ebd0b278ce2b13feffd6bb8a03a3b2ba424009e2e0a020b3e6d772a03a4dc"}
Oct 30 16:28:03.444443 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:03.444389    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-wb4sl" podStartSLOduration=1.928116158 podStartE2EDuration="6.444373301s" totalImagesPullingTime="4.516257143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:28:03.443281343 +0000 UTC m=+502.496558953" watchObservedRunningTime="2026-10-30 16:28:03.444373301 +0000 UTC m=+502.497650910"
Oct 30 16:28:03.804104 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:03.804026    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:03.952243 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:03.952210    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:10.473508 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:10.473476    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:10.695812 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:10.695774    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:13.642960 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:13.642923    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:13.793414 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:13.793382    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:18.100033 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:18.099998    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:18.248736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:18.248705    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:18.449174 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:18.449139    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:20.290424 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:28:20.290391    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:28:23.287836 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:23.287778    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:23.444974 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:23.444940    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:31.792203 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:31.792167    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:39.232588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:39.232554    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:39.407857 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:39.407823    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:43.250725 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:43.250689    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:43.401588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:43.401552    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:50.289961 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:28:50.289921    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:28:52.805493 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.805459    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-ml55g"]
Oct 30 16:28:52.809099 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.809079    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:52.827438 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.827417    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 16:28:52.829283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.829261    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-ml55g"]
Oct 30 16:28:52.853733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.853661    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:52.866004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.865972    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d1fad1c5-780d-4954-b58f-ef6b225fb871-config-file\") pod \"limitador-limitador-74dfcfb894-ml55g\" (UID: \"d1fad1c5-780d-4954-b58f-ef6b225fb871\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:52.866112 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.866055    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28gjc\" (UniqueName: \"kubernetes.io/projected/d1fad1c5-780d-4954-b58f-ef6b225fb871-kube-api-access-28gjc\") pod \"limitador-limitador-74dfcfb894-ml55g\" (UID: \"d1fad1c5-780d-4954-b58f-ef6b225fb871\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:52.938479 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.938450    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-ml55g"]
Oct 30 16:28:52.967490 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.967464    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d1fad1c5-780d-4954-b58f-ef6b225fb871-config-file\") pod \"limitador-limitador-74dfcfb894-ml55g\" (UID: \"d1fad1c5-780d-4954-b58f-ef6b225fb871\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:52.967624 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.967526    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28gjc\" (UniqueName: \"kubernetes.io/projected/d1fad1c5-780d-4954-b58f-ef6b225fb871-kube-api-access-28gjc\") pod \"limitador-limitador-74dfcfb894-ml55g\" (UID: \"d1fad1c5-780d-4954-b58f-ef6b225fb871\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:52.968133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.968114    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d1fad1c5-780d-4954-b58f-ef6b225fb871-config-file\") pod \"limitador-limitador-74dfcfb894-ml55g\" (UID: \"d1fad1c5-780d-4954-b58f-ef6b225fb871\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:52.991081 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:52.991059    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28gjc\" (UniqueName: \"kubernetes.io/projected/d1fad1c5-780d-4954-b58f-ef6b225fb871-kube-api-access-28gjc\") pod \"limitador-limitador-74dfcfb894-ml55g\" (UID: \"d1fad1c5-780d-4954-b58f-ef6b225fb871\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:53.007197 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:53.007171    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:53.121327 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:53.121260    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:53.418574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:53.418546    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-ml55g"]
Oct 30 16:28:53.419412 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:28:53.419390    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fad1c5_780d_4954_b58f_ef6b225fb871.slice/crio-f5e843ba627486a1b0310327bc7924d2e9f2422f02ea8fc0d1ace594d357e326 WatchSource:0}: Error finding container f5e843ba627486a1b0310327bc7924d2e9f2422f02ea8fc0d1ace594d357e326: Status 404 returned error can't find the container with id f5e843ba627486a1b0310327bc7924d2e9f2422f02ea8fc0d1ace594d357e326
Oct 30 16:28:53.618754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:53.618717    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g" event={"ID":"d1fad1c5-780d-4954-b58f-ef6b225fb871","Type":"ContainerStarted","Data":"f5e843ba627486a1b0310327bc7924d2e9f2422f02ea8fc0d1ace594d357e326"}
Oct 30 16:28:53.816468 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:53.816371    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:53.961035 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:53.960991    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:28:55.631713 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:55.631678    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g" event={"ID":"d1fad1c5-780d-4954-b58f-ef6b225fb871","Type":"ContainerStarted","Data":"818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d"}
Oct 30 16:28:55.632102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:55.631735    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:28:55.673473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:28:55.673420    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g" podStartSLOduration=1.6444290929999998 podStartE2EDuration="3.673409289s" totalImagesPullingTime="2.028980196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:28:55.673099516 +0000 UTC m=+554.726377125" watchObservedRunningTime="2026-10-30 16:28:55.673409289 +0000 UTC m=+554.726686898"
Oct 30 16:29:06.637035 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:06.637005    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:29:07.605080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:07.605048    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-ml55g"]
Oct 30 16:29:07.605254 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:07.605232    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g" podUID="d1fad1c5-780d-4954-b58f-ef6b225fb871" containerName="limitador" containerID="cri-o://818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d" gracePeriod=30
Oct 30 16:29:08.551308 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.551284    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:29:08.689953 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.689875    5101 generic.go:356] "Generic (PLEG): container finished" podID="d1fad1c5-780d-4954-b58f-ef6b225fb871" containerID="818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d" exitCode=0
Oct 30 16:29:08.689953 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.689924    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g"
Oct 30 16:29:08.690102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.689921    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g" event={"ID":"d1fad1c5-780d-4954-b58f-ef6b225fb871","Type":"ContainerDied","Data":"818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d"}
Oct 30 16:29:08.690102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.690036    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-ml55g" event={"ID":"d1fad1c5-780d-4954-b58f-ef6b225fb871","Type":"ContainerDied","Data":"f5e843ba627486a1b0310327bc7924d2e9f2422f02ea8fc0d1ace594d357e326"}
Oct 30 16:29:08.690102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.690066    5101 scope.go:122] "RemoveContainer" containerID="818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d"
Oct 30 16:29:08.698070 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.698054    5101 scope.go:122] "RemoveContainer" containerID="818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d"
Oct 30 16:29:08.698226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.698205    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d1fad1c5-780d-4954-b58f-ef6b225fb871-config-file\" (UniqueName: \"kubernetes.io/configmap/d1fad1c5-780d-4954-b58f-ef6b225fb871-config-file\") pod \"d1fad1c5-780d-4954-b58f-ef6b225fb871\" (UID: \"d1fad1c5-780d-4954-b58f-ef6b225fb871\") "
Oct 30 16:29:08.698281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.698239    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1fad1c5-780d-4954-b58f-ef6b225fb871-kube-api-access-28gjc\" (UniqueName: \"kubernetes.io/projected/d1fad1c5-780d-4954-b58f-ef6b225fb871-kube-api-access-28gjc\") pod \"d1fad1c5-780d-4954-b58f-ef6b225fb871\" (UID: \"d1fad1c5-780d-4954-b58f-ef6b225fb871\") "
Oct 30 16:29:08.698438 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:29:08.698416    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d\": container with ID starting with 818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d not found: ID does not exist" containerID="818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d"
Oct 30 16:29:08.698488 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.698449    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d"} err="failed to get container status \"818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d\": rpc error: code = NotFound desc = could not find container \"818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d\": container with ID starting with 818e7f0207db070803f28fa370052b2d344dc906ab68ee35a57b42ca2d87464d not found: ID does not exist"
Oct 30 16:29:08.698745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.698721    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1fad1c5-780d-4954-b58f-ef6b225fb871-config-file" pod "d1fad1c5-780d-4954-b58f-ef6b225fb871" (UID: "d1fad1c5-780d-4954-b58f-ef6b225fb871"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:29:08.700271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.700251    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1fad1c5-780d-4954-b58f-ef6b225fb871-kube-api-access-28gjc" pod "d1fad1c5-780d-4954-b58f-ef6b225fb871" (UID: "d1fad1c5-780d-4954-b58f-ef6b225fb871"). InnerVolumeSpecName "kube-api-access-28gjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:29:08.798857 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.798824    5101 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d1fad1c5-780d-4954-b58f-ef6b225fb871-config-file\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:29:08.798857 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:08.798854    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28gjc\" (UniqueName: \"kubernetes.io/projected/d1fad1c5-780d-4954-b58f-ef6b225fb871-kube-api-access-28gjc\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:29:09.034601 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:09.034574    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-ml55g"]
Oct 30 16:29:09.046187 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:09.046165    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-ml55g"]
Oct 30 16:29:09.072123 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:09.072097    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d1fad1c5-780d-4954-b58f-ef6b225fb871" path="/var/lib/kubelet/pods/d1fad1c5-780d-4954-b58f-ef6b225fb871/volumes"
Oct 30 16:29:10.989824 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:10.989785    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:11.136027 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:11.135998    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:14.094624 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.094588    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:14.251432 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.251403    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:14.790353 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.790319    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"]
Oct 30 16:29:14.790692 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.790680    5101 cpu_manager.go:414] "containerMap: removing container" podUID="d1fad1c5-780d-4954-b58f-ef6b225fb871" containerName="limitador"
Oct 30 16:29:14.790731 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.790694    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1fad1c5-780d-4954-b58f-ef6b225fb871" containerName="limitador"
Oct 30 16:29:14.790780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.790771    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="d1fad1c5-780d-4954-b58f-ef6b225fb871" containerName="limitador"
Oct 30 16:29:14.795110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.795092    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:14.819456 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.819415    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"]
Oct 30 16:29:14.828921 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.828899    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 16:29:14.829077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.828927    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 16:29:14.829077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.828995    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-sx99q\""
Oct 30 16:29:14.829077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.829035    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 16:29:14.949179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.949146    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a-data\") pod \"postgres-7cdbf6dc44-q28lc\" (UID: \"0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:14.949179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.949182    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7g8z\" (UniqueName: \"kubernetes.io/projected/0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a-kube-api-access-n7g8z\") pod \"postgres-7cdbf6dc44-q28lc\" (UID: \"0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:14.951881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:14.951838    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:15.050045 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:15.049964    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7g8z\" (UniqueName: \"kubernetes.io/projected/0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a-kube-api-access-n7g8z\") pod \"postgres-7cdbf6dc44-q28lc\" (UID: \"0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:15.050187 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:15.050090    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a-data\") pod \"postgres-7cdbf6dc44-q28lc\" (UID: \"0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:15.050500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:15.050480    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a-data\") pod \"postgres-7cdbf6dc44-q28lc\" (UID: \"0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:15.073236 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:15.073212    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7g8z\" (UniqueName: \"kubernetes.io/projected/0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a-kube-api-access-n7g8z\") pod \"postgres-7cdbf6dc44-q28lc\" (UID: \"0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:15.108821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:15.108797    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:15.404197 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:15.404169    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"]
Oct 30 16:29:15.405431 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:29:15.405389    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8787b4_3cc8_4cfd_80e5_c8f08b60ed1a.slice/crio-5a272c17198d3a9f22b6086e38ffe3af3db6b3e02422346ff1686503ebe8c445 WatchSource:0}: Error finding container 5a272c17198d3a9f22b6086e38ffe3af3db6b3e02422346ff1686503ebe8c445: Status 404 returned error can't find the container with id 5a272c17198d3a9f22b6086e38ffe3af3db6b3e02422346ff1686503ebe8c445
Oct 30 16:29:15.726897 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:15.726819    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc" event={"ID":"0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a","Type":"ContainerStarted","Data":"5a272c17198d3a9f22b6086e38ffe3af3db6b3e02422346ff1686503ebe8c445"}
Oct 30 16:29:20.292413 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:29:20.292308    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:29:20.756148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:20.756117    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc" event={"ID":"0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a","Type":"ContainerStarted","Data":"46b21566a7aa45685b7a9fe8303aa371f6b1954ef0b29a0a83844ae056ae0aaf"}
Oct 30 16:29:20.756311 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:20.756207    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:20.796604 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:20.796566    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc" podStartSLOduration=2.237107773 podStartE2EDuration="6.796555127s" totalImagesPullingTime="4.559447354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:29:20.796421497 +0000 UTC m=+579.849699118" watchObservedRunningTime="2026-10-30 16:29:20.796555127 +0000 UTC m=+579.849832736"
Oct 30 16:29:26.789278 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:26.789208    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-q28lc"
Oct 30 16:29:27.291372 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:27.291325    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:27.435877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:27.435850    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:31.911742 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:31.911696    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:36.455627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.455595    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:36.500872 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.500835    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-577f596567-jcz8c"]
Oct 30 16:29:36.522193 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.522160    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.531972 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.531941    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-jcz8c"]
Oct 30 16:29:36.535933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.535876    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwpk5\" (UniqueName: \"kubernetes.io/projected/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-kube-api-access-kwpk5\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.536052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.535967    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.536052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.536015    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-metrics-certs\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.541730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.541704    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 16:29:36.541886 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.541755    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 16:29:36.541886 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.541861    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lvg8k\""
Oct 30 16:29:36.541886 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.541875    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 16:29:36.610712 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.610679    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:36.637266 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.637235    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpk5\" (UniqueName: \"kubernetes.io/projected/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-kube-api-access-kwpk5\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.637454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.637280    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.637454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.637320    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-metrics-certs\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.637574 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:29:36.637451    5101 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Oct 30 16:29:36.637574 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:29:36.637520    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert podName:ef7b33ea-3a1e-4d32-98d9-492b17d533bc nodeName:}" failed. No retries permitted until 2026-10-30 16:29:37.137501682 +0000 UTC m=+596.190779277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert") pod "maas-controller-577f596567-jcz8c" (UID: "ef7b33ea-3a1e-4d32-98d9-492b17d533bc") : secret "maas-controller-webhook-cert" not found
Oct 30 16:29:36.639808 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.639788    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-metrics-certs\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.661906 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.661882    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwpk5\" (UniqueName: \"kubernetes.io/projected/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-kube-api-access-kwpk5\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:36.793227 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.793147    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:36.897994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.897958    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85bb7dd889-frdsz"]
Oct 30 16:29:36.901696 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.901673    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:36.923526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.923499    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85bb7dd889-frdsz"]
Oct 30 16:29:36.938378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.938334    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:36.940563 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.940536    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68t7l\" (UniqueName: \"kubernetes.io/projected/0ba1ef36-def2-4766-b957-9dd2e574165c-kube-api-access-68t7l\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:36.940563 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.940565    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-metrics-certs\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:36.940747 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:36.940600    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-webhook-cert\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:37.041331 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.041296    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68t7l\" (UniqueName: \"kubernetes.io/projected/0ba1ef36-def2-4766-b957-9dd2e574165c-kube-api-access-68t7l\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:37.041331 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.041333    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-metrics-certs\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:37.041544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.041401    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-webhook-cert\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:37.043892 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.043848    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-metrics-certs\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:37.043953 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.043892    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-webhook-cert\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:37.064407 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.064387    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68t7l\" (UniqueName: \"kubernetes.io/projected/0ba1ef36-def2-4766-b957-9dd2e574165c-kube-api-access-68t7l\") pod \"maas-controller-85bb7dd889-frdsz\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") " pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:37.141975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.141936    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:37.144149 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.144128    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert\") pod \"maas-controller-577f596567-jcz8c\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") " pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:37.214431 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.214399    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:37.439434 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.439404    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:37.509633 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.509607    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85bb7dd889-frdsz"]
Oct 30 16:29:37.511272 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:29:37.511243    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba1ef36_def2_4766_b957_9dd2e574165c.slice/crio-367e4ed0e4cf19272ff72e2243250246c4ee089ebb166ac481e80032d1a4d173 WatchSource:0}: Error finding container 367e4ed0e4cf19272ff72e2243250246c4ee089ebb166ac481e80032d1a4d173: Status 404 returned error can't find the container with id 367e4ed0e4cf19272ff72e2243250246c4ee089ebb166ac481e80032d1a4d173
Oct 30 16:29:37.734036 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.734007    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-jcz8c"]
Oct 30 16:29:37.735128 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:29:37.735101    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7b33ea_3a1e_4d32_98d9_492b17d533bc.slice/crio-8f55c8558c25f4fd62f798dce42db648074b0ff6c8786d7501b5796172016686 WatchSource:0}: Error finding container 8f55c8558c25f4fd62f798dce42db648074b0ff6c8786d7501b5796172016686: Status 404 returned error can't find the container with id 8f55c8558c25f4fd62f798dce42db648074b0ff6c8786d7501b5796172016686
Oct 30 16:29:37.830098 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.830066    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-jcz8c" event={"ID":"ef7b33ea-3a1e-4d32-98d9-492b17d533bc","Type":"ContainerStarted","Data":"8f55c8558c25f4fd62f798dce42db648074b0ff6c8786d7501b5796172016686"}
Oct 30 16:29:37.831257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.831232    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85bb7dd889-frdsz" event={"ID":"0ba1ef36-def2-4766-b957-9dd2e574165c","Type":"ContainerStarted","Data":"367e4ed0e4cf19272ff72e2243250246c4ee089ebb166ac481e80032d1a4d173"}
Oct 30 16:29:37.862151 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:37.862117    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:38.000578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:38.000488    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:40.538742 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:40.538630    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:40.685078 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:40.685037    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:40.853439 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:40.853321    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-jcz8c" event={"ID":"ef7b33ea-3a1e-4d32-98d9-492b17d533bc","Type":"ContainerStarted","Data":"9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904"}
Oct 30 16:29:40.853603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:40.853543    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:40.855037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:40.855011    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85bb7dd889-frdsz" event={"ID":"0ba1ef36-def2-4766-b957-9dd2e574165c","Type":"ContainerStarted","Data":"186090d6d348d3de9b7fb8ff56660a670384eff63d1f70ebbbe12d3e9c40b051"}
Oct 30 16:29:40.855153 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:40.855142    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:40.897265 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:40.897222    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-577f596567-jcz8c" podStartSLOduration=2.25360933 podStartE2EDuration="4.897210688s" totalImagesPullingTime="2.643601358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:29:40.89582187 +0000 UTC m=+599.949099477" watchObservedRunningTime="2026-10-30 16:29:40.897210688 +0000 UTC m=+599.950488296"
Oct 30 16:29:40.937248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:40.937198    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-85bb7dd889-frdsz" podStartSLOduration=2.217855818 podStartE2EDuration="4.937185747s" totalImagesPullingTime="2.719329929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:29:40.93692924 +0000 UTC m=+599.990206851" watchObservedRunningTime="2026-10-30 16:29:40.937185747 +0000 UTC m=+599.990463353"
Oct 30 16:29:41.131773 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:41.131752    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:29:41.134306 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:41.134284    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:29:41.135009 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:41.134993    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:29:41.138019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:41.138000    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:29:43.899642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:43.899612    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"]
Oct 30 16:29:43.904523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:43.904494    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:43.923260 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:43.923234    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 16:29:43.923260 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:43.923254    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 16:29:43.923477 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:43.923234    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-7lxt4\""
Oct 30 16:29:43.923477 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:43.923361    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 16:29:43.925427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:43.925406    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"]
Oct 30 16:29:44.006746 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.006714    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/890b31e3-1a31-4273-aa31-3be7b6adf0a8-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.006926 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.006769    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/890b31e3-1a31-4273-aa31-3be7b6adf0a8-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.006926 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.006876    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/890b31e3-1a31-4273-aa31-3be7b6adf0a8-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.006926 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.006913    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhw8\" (UniqueName: \"kubernetes.io/projected/890b31e3-1a31-4273-aa31-3be7b6adf0a8-kube-api-access-sjhw8\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.039354 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.039281    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:44.107617 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.107589    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/890b31e3-1a31-4273-aa31-3be7b6adf0a8-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.107769 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.107644    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/890b31e3-1a31-4273-aa31-3be7b6adf0a8-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.107769 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.107673    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhw8\" (UniqueName: \"kubernetes.io/projected/890b31e3-1a31-4273-aa31-3be7b6adf0a8-kube-api-access-sjhw8\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.107769 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.107765    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/890b31e3-1a31-4273-aa31-3be7b6adf0a8-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.108268 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.108247    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/890b31e3-1a31-4273-aa31-3be7b6adf0a8-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.108475 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.108456    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/890b31e3-1a31-4273-aa31-3be7b6adf0a8-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.110003 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.109987    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/890b31e3-1a31-4273-aa31-3be7b6adf0a8-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.131058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.131038    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhw8\" (UniqueName: \"kubernetes.io/projected/890b31e3-1a31-4273-aa31-3be7b6adf0a8-kube-api-access-sjhw8\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-p8rlm\" (UID: \"890b31e3-1a31-4273-aa31-3be7b6adf0a8\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.188567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.188507    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:29:44.216831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.216808    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:44.510375 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.510334    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"]
Oct 30 16:29:44.511323 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:29:44.511297    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890b31e3_1a31_4273_aa31_3be7b6adf0a8.slice/crio-57c6771b25a9322230a2e5eec1654b67aab60e77ab8e18e773fbd4389fb2cf8f WatchSource:0}: Error finding container 57c6771b25a9322230a2e5eec1654b67aab60e77ab8e18e773fbd4389fb2cf8f: Status 404 returned error can't find the container with id 57c6771b25a9322230a2e5eec1654b67aab60e77ab8e18e773fbd4389fb2cf8f
Oct 30 16:29:44.874248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:44.874169    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm" event={"ID":"890b31e3-1a31-4273-aa31-3be7b6adf0a8","Type":"ContainerStarted","Data":"57c6771b25a9322230a2e5eec1654b67aab60e77ab8e18e773fbd4389fb2cf8f"}
Oct 30 16:29:50.296498 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:29:50.296459    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:29:51.862837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:51.862805    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:29:51.863265 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:51.862890    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:51.980375 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:51.979790    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-jcz8c"]
Oct 30 16:29:51.981162 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:51.981125    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-577f596567-jcz8c" podUID="ef7b33ea-3a1e-4d32-98d9-492b17d533bc" containerName="manager" containerID="cri-o://9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904" gracePeriod=30
Oct 30 16:29:52.246754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.246727    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:52.385401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.385364    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-metrics-certs\") pod \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") "
Oct 30 16:29:52.385578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.385455    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-kube-api-access-kwpk5\" (UniqueName: \"kubernetes.io/projected/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-kube-api-access-kwpk5\") pod \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") "
Oct 30 16:29:52.385578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.385510    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert\") pod \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\" (UID: \"ef7b33ea-3a1e-4d32-98d9-492b17d533bc\") "
Oct 30 16:29:52.387873 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.387845    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-kube-api-access-kwpk5" pod "ef7b33ea-3a1e-4d32-98d9-492b17d533bc" (UID: "ef7b33ea-3a1e-4d32-98d9-492b17d533bc"). InnerVolumeSpecName "kube-api-access-kwpk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:29:52.387873 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.387859    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-metrics-certs" pod "ef7b33ea-3a1e-4d32-98d9-492b17d533bc" (UID: "ef7b33ea-3a1e-4d32-98d9-492b17d533bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:29:52.388032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.387937    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert" pod "ef7b33ea-3a1e-4d32-98d9-492b17d533bc" (UID: "ef7b33ea-3a1e-4d32-98d9-492b17d533bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:29:52.486652 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.486581    5101 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-metrics-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:29:52.486652 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.486609    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwpk5\" (UniqueName: \"kubernetes.io/projected/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-kube-api-access-kwpk5\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:29:52.486652 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.486620    5101 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef7b33ea-3a1e-4d32-98d9-492b17d533bc-webhook-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:29:52.925934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.925900    5101 generic.go:356] "Generic (PLEG): container finished" podID="ef7b33ea-3a1e-4d32-98d9-492b17d533bc" containerID="9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904" exitCode=0
Oct 30 16:29:52.926416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.925938    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-jcz8c" event={"ID":"ef7b33ea-3a1e-4d32-98d9-492b17d533bc","Type":"ContainerDied","Data":"9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904"}
Oct 30 16:29:52.926416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.925961    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-jcz8c"
Oct 30 16:29:52.926416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.926008    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-jcz8c" event={"ID":"ef7b33ea-3a1e-4d32-98d9-492b17d533bc","Type":"ContainerDied","Data":"8f55c8558c25f4fd62f798dce42db648074b0ff6c8786d7501b5796172016686"}
Oct 30 16:29:52.926416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.926035    5101 scope.go:122] "RemoveContainer" containerID="9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904"
Oct 30 16:29:52.937334 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.937311    5101 scope.go:122] "RemoveContainer" containerID="9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904"
Oct 30 16:29:52.937639 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:29:52.937606    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904\": container with ID starting with 9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904 not found: ID does not exist" containerID="9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904"
Oct 30 16:29:52.937725 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.937641    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904"} err="failed to get container status \"9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904\": rpc error: code = NotFound desc = could not find container \"9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904\": container with ID starting with 9ff98a41892e0939f81e2c44a37bb66762d40188a58e3212e69d69d3f6698904 not found: ID does not exist"
Oct 30 16:29:52.977628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.977596    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-jcz8c"]
Oct 30 16:29:52.989359 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:52.989326    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-577f596567-jcz8c"]
Oct 30 16:29:53.073170 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:53.073138    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef7b33ea-3a1e-4d32-98d9-492b17d533bc" path="/var/lib/kubelet/pods/ef7b33ea-3a1e-4d32-98d9-492b17d533bc/volumes"
Oct 30 16:29:54.944194 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:54.944154    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm" event={"ID":"890b31e3-1a31-4273-aa31-3be7b6adf0a8","Type":"ContainerStarted","Data":"7b6855a6cc3667de95eefcb80fb963a869993ba1a28540d98d0907b1d664d18b"}
Oct 30 16:29:54.944689 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:54.944271    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:29:54.985931 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:29:54.985886    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm" podStartSLOduration=1.996919037 podStartE2EDuration="11.985875469s" totalImagesPullingTime="9.988956432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:29:54.984313959 +0000 UTC m=+614.037591569" watchObservedRunningTime="2026-10-30 16:29:54.985875469 +0000 UTC m=+614.039153079"
Oct 30 16:30:02.949659 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:02.949599    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:30:05.954635 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:05.954607    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-p8rlm"
Oct 30 16:30:12.851800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:12.851748    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:30:13.012539 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:13.012505    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:30:14.422230 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:14.422195    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:30:14.613842 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:14.613806    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:30:14.775929 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:14.775857    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:30:20.290645 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:30:20.290610    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:30:32.038731 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:32.038687    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:30:50.290596 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:30:50.290557    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:30:59.275383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:59.275302    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:30:59.458565 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:30:59.458518    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:20.290746 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:31:20.290711    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:31:20.802296 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.802260    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"]
Oct 30 16:31:20.802670 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.802657    5101 cpu_manager.go:414] "containerMap: removing container" podUID="ef7b33ea-3a1e-4d32-98d9-492b17d533bc" containerName="manager"
Oct 30 16:31:20.802714 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.802671    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef7b33ea-3a1e-4d32-98d9-492b17d533bc" containerName="manager"
Oct 30 16:31:20.802746 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.802737    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef7b33ea-3a1e-4d32-98d9-492b17d533bc" containerName="manager"
Oct 30 16:31:20.806470 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.806446    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.822205 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.822183    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fv4q6\""
Oct 30 16:31:20.825953 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.825919    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.826103 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.826076    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxd75\" (UniqueName: \"kubernetes.io/projected/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-kube-api-access-lxd75\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.826191 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.826171    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.826240 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.826218    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.826317 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.826295    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.826483 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.826458    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.834658 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.834622    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 16:31:20.834658 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.834636    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 16:31:20.834827 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.834721    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 16:31:20.839090 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.839071    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"]
Oct 30 16:31:20.918568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.918532    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:20.927643 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.927614    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxd75\" (UniqueName: \"kubernetes.io/projected/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-kube-api-access-lxd75\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.927774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.927649    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.927774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.927667    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.927774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.927695    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.927774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.927751    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.927930 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.927812    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.928094 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.928074    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.928168 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.928121    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.928226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.928211    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.929925 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.929902    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.930169 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.930154    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:20.950917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:20.950888    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxd75\" (UniqueName: \"kubernetes.io/projected/8d0a71c1-e789-4407-89b5-7b3ed6ea114f-kube-api-access-lxd75\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-76mjt\" (UID: \"8d0a71c1-e789-4407-89b5-7b3ed6ea114f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:21.119508 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:21.119421    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:21.417544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:21.417518    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"]
Oct 30 16:31:21.418883 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:31:21.418860    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0a71c1_e789_4407_89b5_7b3ed6ea114f.slice/crio-975aea3d07eb983e8c5223f47e04b9feec5ad98762bf3c7a946f2bcf5fbb52da WatchSource:0}: Error finding container 975aea3d07eb983e8c5223f47e04b9feec5ad98762bf3c7a946f2bcf5fbb52da: Status 404 returned error can't find the container with id 975aea3d07eb983e8c5223f47e04b9feec5ad98762bf3c7a946f2bcf5fbb52da
Oct 30 16:31:21.420138 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:21.420121    5101 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:31:22.325483 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:22.325448    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt" event={"ID":"8d0a71c1-e789-4407-89b5-7b3ed6ea114f","Type":"ContainerStarted","Data":"975aea3d07eb983e8c5223f47e04b9feec5ad98762bf3c7a946f2bcf5fbb52da"}
Oct 30 16:31:23.320592 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.320558    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:23.332143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.332106    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt" event={"ID":"8d0a71c1-e789-4407-89b5-7b3ed6ea114f","Type":"ContainerStarted","Data":"9ea1dbc3b455ee6d66e82255a4259411659f9c410213cdca14eed3235f0b8e14"}
Oct 30 16:31:23.375470 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.375425    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt" podStartSLOduration=2.384817457 podStartE2EDuration="3.375411784s" totalImagesPullingTime="990.594327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:31:23.374391642 +0000 UTC m=+702.427669251" watchObservedRunningTime="2026-10-30 16:31:23.375411784 +0000 UTC m=+702.428689394"
Oct 30 16:31:23.538586 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.538546    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"]
Oct 30 16:31:23.542822 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.542799    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.560762 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.560739    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 30 16:31:23.571939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.571878    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"]
Oct 30 16:31:23.651571 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.651533    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.651730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.651577    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzffp\" (UniqueName: \"kubernetes.io/projected/fe052556-7fdf-4027-840b-95572d395bff-kube-api-access-pzffp\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.651792 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.651736    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe052556-7fdf-4027-840b-95572d395bff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.651844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.651810    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.651902 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.651852    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.651942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.651911    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.654572 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.654543    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:23.752764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.752730    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe052556-7fdf-4027-840b-95572d395bff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.752764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.752765    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.752995 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.752788    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.752995 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.752813    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.752995 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.752850    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.752995 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.752877    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzffp\" (UniqueName: \"kubernetes.io/projected/fe052556-7fdf-4027-840b-95572d395bff-kube-api-access-pzffp\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.753292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.753259    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.753292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.753279    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.753471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.753330    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.755028 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.755001    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe052556-7fdf-4027-840b-95572d395bff-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.755260 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.755243    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe052556-7fdf-4027-840b-95572d395bff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.776409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.776389    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzffp\" (UniqueName: \"kubernetes.io/projected/fe052556-7fdf-4027-840b-95572d395bff-kube-api-access-pzffp\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-c4jq5\" (UID: \"fe052556-7fdf-4027-840b-95572d395bff\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:23.856068 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:23.855992    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:24.120123 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:24.120052    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:24.156756 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:24.156724    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"]
Oct 30 16:31:24.157349 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:31:24.157312    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe052556_7fdf_4027_840b_95572d395bff.slice/crio-474d070ed12b42b2b865d2cd4c18d04664c9a13e46d81af7acbb0c0354e68fe8 WatchSource:0}: Error finding container 474d070ed12b42b2b865d2cd4c18d04664c9a13e46d81af7acbb0c0354e68fe8: Status 404 returned error can't find the container with id 474d070ed12b42b2b865d2cd4c18d04664c9a13e46d81af7acbb0c0354e68fe8
Oct 30 16:31:24.337812 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:24.337774    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5" event={"ID":"fe052556-7fdf-4027-840b-95572d395bff","Type":"ContainerStarted","Data":"474d070ed12b42b2b865d2cd4c18d04664c9a13e46d81af7acbb0c0354e68fe8"}
Oct 30 16:31:25.343908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:25.343873    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5" event={"ID":"fe052556-7fdf-4027-840b-95572d395bff","Type":"ContainerStarted","Data":"b4d5ede8cbdc4abad1ad602c0d9adfbde8ebea9a822e76cb9814e3da78459508"}
Oct 30 16:31:25.386232 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:25.386175    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5" podStartSLOduration=2.1650647530000002 podStartE2EDuration="2.386161356s" totalImagesPullingTime="221.096603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:31:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:31:25.385600566 +0000 UTC m=+704.438878175" watchObservedRunningTime="2026-10-30 16:31:25.386161356 +0000 UTC m=+704.439438965"
Oct 30 16:31:25.856523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:25.856489    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:26.366170 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.366140    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"]
Oct 30 16:31:26.369790 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.369774    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.397032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.396996    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 30 16:31:26.399029 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.399008    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"]
Oct 30 16:31:26.468835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.468804    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:26.475913 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.475890    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.475983 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.475937    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2255246-1390-46f8-959c-2d3e3ecae1d3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.475983 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.475961    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4sb\" (UniqueName: \"kubernetes.io/projected/d2255246-1390-46f8-959c-2d3e3ecae1d3-kube-api-access-hw4sb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.476065 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.476044    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.476100 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.476082    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.476129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.476114    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.576776 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.576745    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2255246-1390-46f8-959c-2d3e3ecae1d3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.576776 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.576777    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4sb\" (UniqueName: \"kubernetes.io/projected/d2255246-1390-46f8-959c-2d3e3ecae1d3-kube-api-access-hw4sb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.577004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.576802    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.577004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.576827    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.577004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.576870    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.577004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.576959    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.577257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.577236    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.577316 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.577275    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.577316 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.577290    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.578995 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.578974    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2255246-1390-46f8-959c-2d3e3ecae1d3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.579200 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.579185    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2255246-1390-46f8-959c-2d3e3ecae1d3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.599805 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.599784    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4sb\" (UniqueName: \"kubernetes.io/projected/d2255246-1390-46f8-959c-2d3e3ecae1d3-kube-api-access-hw4sb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx\" (UID: \"d2255246-1390-46f8-959c-2d3e3ecae1d3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.683477 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.683445    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:26.981818 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:26.981790    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"]
Oct 30 16:31:26.982657 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:31:26.982629    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2255246_1390_46f8_959c_2d3e3ecae1d3.slice/crio-d16bb338c2fe8f057ae4f9f090c2f84ee4303f029dc1e5542ac697caab581c29 WatchSource:0}: Error finding container d16bb338c2fe8f057ae4f9f090c2f84ee4303f029dc1e5542ac697caab581c29: Status 404 returned error can't find the container with id d16bb338c2fe8f057ae4f9f090c2f84ee4303f029dc1e5542ac697caab581c29
Oct 30 16:31:27.354546 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:27.354503    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx" event={"ID":"d2255246-1390-46f8-959c-2d3e3ecae1d3","Type":"ContainerStarted","Data":"da9042b55102523590f6fc1876b42b7ee889eb37d4afcd957328990f233761cf"}
Oct 30 16:31:27.354735 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:27.354568    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx" event={"ID":"d2255246-1390-46f8-959c-2d3e3ecae1d3","Type":"ContainerStarted","Data":"d16bb338c2fe8f057ae4f9f090c2f84ee4303f029dc1e5542ac697caab581c29"}
Oct 30 16:31:27.398802 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:27.398756    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx" podStartSLOduration=1.208218808 podStartE2EDuration="1.398743477s" totalImagesPullingTime="190.524669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:31:27.396263101 +0000 UTC m=+706.449540711" watchObservedRunningTime="2026-10-30 16:31:27.398743477 +0000 UTC m=+706.452021087"
Oct 30 16:31:27.683887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:27.683860    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:28.088814 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:28.088736    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:29.384817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:29.384785    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:31.120217 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:31.120182    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:31.132475 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:31.132450    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:31.384209 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:31.384135    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-76mjt"
Oct 30 16:31:31.764774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:31.764735    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:32.156747 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:32.156719    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:32.965327 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:32.965292    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"]
Oct 30 16:31:32.969527 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:32.969507    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:32.996416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:32.996394    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 16:31:32.998928 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:32.998905    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"]
Oct 30 16:31:33.034917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.034890    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.035036 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.034940    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f95fa666-ca94-4394-9f21-22d210546af0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.035077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.035029    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.035077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.035066    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.035147 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.035100    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7pt7\" (UniqueName: \"kubernetes.io/projected/f95fa666-ca94-4394-9f21-22d210546af0-kube-api-access-p7pt7\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.035147 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.035117    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.065232 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.065201    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:33.136581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.136552    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.136581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.136595    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.136804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.136626    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pt7\" (UniqueName: \"kubernetes.io/projected/f95fa666-ca94-4394-9f21-22d210546af0-kube-api-access-p7pt7\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.136804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.136746    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.136935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.136811    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.136935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.136881    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f95fa666-ca94-4394-9f21-22d210546af0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.137075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.137056    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.137133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.137073    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.137167 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.137141    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.138879 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.138854    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f95fa666-ca94-4394-9f21-22d210546af0-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.139364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.139332    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f95fa666-ca94-4394-9f21-22d210546af0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.160597 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.160576    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7pt7\" (UniqueName: \"kubernetes.io/projected/f95fa666-ca94-4394-9f21-22d210546af0-kube-api-access-p7pt7\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds\" (UID: \"f95fa666-ca94-4394-9f21-22d210546af0\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.284139 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.284066    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:33.584557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.584527    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"]
Oct 30 16:31:33.585227 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:31:33.585198    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95fa666_ca94_4394_9f21_22d210546af0.slice/crio-98153623424d21f1278a249338ed6dbc2963a0900eb35c98b82c907dee79d566 WatchSource:0}: Error finding container 98153623424d21f1278a249338ed6dbc2963a0900eb35c98b82c907dee79d566: Status 404 returned error can't find the container with id 98153623424d21f1278a249338ed6dbc2963a0900eb35c98b82c907dee79d566
Oct 30 16:31:33.857116 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.857090    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:33.869896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:33.869873    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:34.398965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.398927    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds" event={"ID":"f95fa666-ca94-4394-9f21-22d210546af0","Type":"ContainerStarted","Data":"0e3ff95b37df891892c02ffdf5f88bf89ff9b7a67ba60f8d9aecb84fe4ad77e5"}
Oct 30 16:31:34.399453 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.398984    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds" event={"ID":"f95fa666-ca94-4394-9f21-22d210546af0","Type":"ContainerStarted","Data":"98153623424d21f1278a249338ed6dbc2963a0900eb35c98b82c907dee79d566"}
Oct 30 16:31:34.409700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.409678    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-c4jq5"
Oct 30 16:31:34.443923 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.443879    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds" podStartSLOduration=2.246725054 podStartE2EDuration="2.443867008s" totalImagesPullingTime="197.141954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:31:34.442060227 +0000 UTC m=+713.495337848" watchObservedRunningTime="2026-10-30 16:31:34.443867008 +0000 UTC m=+713.497144617"
Oct 30 16:31:34.877956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.877889    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"]
Oct 30 16:31:34.881754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.881733    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:34.898230 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.898208    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 30 16:31:34.910622 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.910599    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"]
Oct 30 16:31:34.954410 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.954382    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:34.954538 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.954421    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qfjn\" (UniqueName: \"kubernetes.io/projected/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-kube-api-access-4qfjn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:34.954538 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.954444    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:34.954642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.954546    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:34.954642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.954588    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:34.954721 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.954681    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:34.976908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:34.976884    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:35.055550 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.055518    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.055674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.055567    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qfjn\" (UniqueName: \"kubernetes.io/projected/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-kube-api-access-4qfjn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.055674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.055589    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.055674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.055618    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.055674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.055659    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.055866 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.055824    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.056044 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.056023    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.056142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.056055    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.056142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.056107    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.057731 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.057713    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.058116 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.058099    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.080707 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.080687    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qfjn\" (UniqueName: \"kubernetes.io/projected/dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3-kube-api-access-4qfjn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4xpf\" (UID: \"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.196372 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.196349    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:35.284754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.284722    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:35.494316 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:35.494281    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"]
Oct 30 16:31:35.494915 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:31:35.494892    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb79bf8_16b2_4030_abbb_c3c4c9fc62a3.slice/crio-a003939759146f1cf8a40ed170ed85df9b77f3b681ef1f786ef86fbeff479ae5 WatchSource:0}: Error finding container a003939759146f1cf8a40ed170ed85df9b77f3b681ef1f786ef86fbeff479ae5: Status 404 returned error can't find the container with id a003939759146f1cf8a40ed170ed85df9b77f3b681ef1f786ef86fbeff479ae5
Oct 30 16:31:36.410519 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:36.410479    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf" event={"ID":"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3","Type":"ContainerStarted","Data":"eeaf73de4d4a7862a94a95a4c0f9d9c167948a2985130adf568924c478c001fe"}
Oct 30 16:31:36.410727 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:36.410539    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf" event={"ID":"dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3","Type":"ContainerStarted","Data":"a003939759146f1cf8a40ed170ed85df9b77f3b681ef1f786ef86fbeff479ae5"}
Oct 30 16:31:36.453243 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:36.453195    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf" podStartSLOduration=2.206329775 podStartE2EDuration="2.453181808s" totalImagesPullingTime="246.852033ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:31:36.452837598 +0000 UTC m=+715.506115210" watchObservedRunningTime="2026-10-30 16:31:36.453181808 +0000 UTC m=+715.506459418"
Oct 30 16:31:36.684046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:36.683960    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:36.696018 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:36.695990    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:37.197146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:37.197107    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:37.426241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:37.426211    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx"
Oct 30 16:31:43.284856 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:43.284812    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:43.296935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:43.296904    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:43.452651 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:43.452626    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds"
Oct 30 16:31:45.196562 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:45.196523    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:45.208447 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:45.208419    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:45.462376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:45.462278    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4xpf"
Oct 30 16:31:48.592214 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:48.592176    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:50.290327 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:31:50.290290    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:31:50.406887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:50.406847    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:50.574952 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:50.574878    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:55.092600 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.092555    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"]
Oct 30 16:31:55.099336 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.099312    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.114962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.114937    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 16:31:55.115103 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.114976    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sgq7n\""
Oct 30 16:31:55.130107 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.130078    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"]
Oct 30 16:31:55.240285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240251    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.240469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240291    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.240515 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240468    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.240515 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240504    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.240598 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240527    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.240632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240595    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.240673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240640    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.240673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240657    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r959\" (UniqueName: \"kubernetes.io/projected/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-kube-api-access-2r959\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.240779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.240761    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.341604 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341569    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.341785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341614    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.341785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341640    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.341785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341672    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.341785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341735    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.341785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341758    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r959\" (UniqueName: \"kubernetes.io/projected/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-kube-api-access-2r959\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.342031 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341807    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.342031 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341841    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.342031 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.341863    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.342031 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.342010    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.342230 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.342064    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.342326 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.342276    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.342326 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.342317    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.342506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.342402    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.343984 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.343932    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.344367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.344331    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.366441 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.366403    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.366691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.366668    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r959\" (UniqueName: \"kubernetes.io/projected/9d0c1cd2-06b6-4489-a509-cfb3ec71debc-kube-api-access-2r959\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq\" (UID: \"9d0c1cd2-06b6-4489-a509-cfb3ec71debc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.413079 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.413047    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:55.473406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.473372    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:55.644144 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.644107    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:31:55.738121 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:55.738096    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"]
Oct 30 16:31:55.738515 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:31:55.738482    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0c1cd2_06b6_4489_a509_cfb3ec71debc.slice/crio-9b8159023837576e26cb3bd82d611e4d9dfbdc228d6cfc77c62c23f44ae5bc07 WatchSource:0}: Error finding container 9b8159023837576e26cb3bd82d611e4d9dfbdc228d6cfc77c62c23f44ae5bc07: Status 404 returned error can't find the container with id 9b8159023837576e26cb3bd82d611e4d9dfbdc228d6cfc77c62c23f44ae5bc07
Oct 30 16:31:56.524589 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:56.524549    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" event={"ID":"9d0c1cd2-06b6-4489-a509-cfb3ec71debc","Type":"ContainerStarted","Data":"9b8159023837576e26cb3bd82d611e4d9dfbdc228d6cfc77c62c23f44ae5bc07"}
Oct 30 16:31:58.137133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:58.137101    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:31:58.137437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:58.137167    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:31:58.137437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:58.137196    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:31:58.540982 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:58.539378    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" event={"ID":"9d0c1cd2-06b6-4489-a509-cfb3ec71debc","Type":"ContainerStarted","Data":"9eea8d046a7b90c11b8ffac51fc62cdfa05997b4b8ca78802ce976e4b17c5970"}
Oct 30 16:31:58.611796 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:58.611741    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podStartSLOduration=1.215916441 podStartE2EDuration="3.611728999s" totalImagesPullingTime="2.395812558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:31:58.598372728 +0000 UTC m=+737.651650335" watchObservedRunningTime="2026-10-30 16:31:58.611728999 +0000 UTC m=+737.665006655"
Oct 30 16:31:59.413616 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:59.413546    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:31:59.415110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:59.415086    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:31:59.415240 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:31:59.415135    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podUID="9d0c1cd2-06b6-4489-a509-cfb3ec71debc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 16:32:00.414055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:00.414019    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:32:00.414457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:00.414082    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podUID="9d0c1cd2-06b6-4489-a509-cfb3ec71debc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 16:32:01.414076 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:01.414043    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:32:01.414474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:01.414096    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podUID="9d0c1cd2-06b6-4489-a509-cfb3ec71debc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 16:32:02.413820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:02.413783    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:32:02.414005 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:02.413846    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podUID="9d0c1cd2-06b6-4489-a509-cfb3ec71debc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 16:32:03.414264 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:03.414234    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:32:03.414658 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:03.414283    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podUID="9d0c1cd2-06b6-4489-a509-cfb3ec71debc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 16:32:04.413587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:04.413553    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:32:04.413755 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:04.413614    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podUID="9d0c1cd2-06b6-4489-a509-cfb3ec71debc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 16:32:06.072042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:06.072000    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:32:06.072585 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:06.072372    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:32:06.073244 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:06.073222    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq"
Oct 30 16:32:10.135445 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.135411    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"]
Oct 30 16:32:10.140176 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.140156    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.171930 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.171902    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"]
Oct 30 16:32:10.192256 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192223    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.192429 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192274    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.192429 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192367    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.192429 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192399    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e716a2-f834-4286-9218-0d998953696a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.192429 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192428    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e716a2-f834-4286-9218-0d998953696a-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.192627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192494    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smtmf\" (UniqueName: \"kubernetes.io/projected/19e716a2-f834-4286-9218-0d998953696a-kube-api-access-smtmf\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.192627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192553    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e716a2-f834-4286-9218-0d998953696a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.192627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192590    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.192738 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.192655    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293162 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293134    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293305 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293169    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e716a2-f834-4286-9218-0d998953696a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293390 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293364    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e716a2-f834-4286-9218-0d998953696a-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293481 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293466    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smtmf\" (UniqueName: \"kubernetes.io/projected/19e716a2-f834-4286-9218-0d998953696a-kube-api-access-smtmf\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293539 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293507    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e716a2-f834-4286-9218-0d998953696a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293540    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293570    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293695 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293626    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293695 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293670    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.293898 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293869    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.294022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293947    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e716a2-f834-4286-9218-0d998953696a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.294022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.293977    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.294101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.294046    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.294135 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.294122    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.295482 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.295464    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e716a2-f834-4286-9218-0d998953696a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.295885 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.295854    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e716a2-f834-4286-9218-0d998953696a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.316465 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.316440    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e716a2-f834-4286-9218-0d998953696a-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.316574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.316557    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smtmf\" (UniqueName: \"kubernetes.io/projected/19e716a2-f834-4286-9218-0d998953696a-kube-api-access-smtmf\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk\" (UID: \"19e716a2-f834-4286-9218-0d998953696a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.452658 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.452626    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:10.766016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.765990    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"]
Oct 30 16:32:10.766930 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:32:10.766900    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e716a2_f834_4286_9218_0d998953696a.slice/crio-f119e759d6abdade254bf792c65569341e8966c74da84018764132f1acd2157f WatchSource:0}: Error finding container f119e759d6abdade254bf792c65569341e8966c74da84018764132f1acd2157f: Status 404 returned error can't find the container with id f119e759d6abdade254bf792c65569341e8966c74da84018764132f1acd2157f
Oct 30 16:32:10.769759 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.769724    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:10.769851 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.769787    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:10.769851 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:10.769813    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:11.622425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:11.622385    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" event={"ID":"19e716a2-f834-4286-9218-0d998953696a","Type":"ContainerStarted","Data":"636282689c070a5da3cc9b3af6d7bf7c1d4460a12b23b2e766573824961d32a1"}
Oct 30 16:32:11.622824 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:11.622480    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" event={"ID":"19e716a2-f834-4286-9218-0d998953696a","Type":"ContainerStarted","Data":"f119e759d6abdade254bf792c65569341e8966c74da84018764132f1acd2157f"}
Oct 30 16:32:11.696965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:11.696911    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podStartSLOduration=1.6968965310000002 podStartE2EDuration="1.696896531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:32:11.695007373 +0000 UTC m=+750.748284983" watchObservedRunningTime="2026-10-30 16:32:11.696896531 +0000 UTC m=+750.750174140"
Oct 30 16:32:12.459364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:12.457785    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:12.468813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:12.468769    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:32:12.468969 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:12.468839    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podUID="19e716a2-f834-4286-9218-0d998953696a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 16:32:13.467517 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:13.467483    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:32:13.467983 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:13.467556    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podUID="19e716a2-f834-4286-9218-0d998953696a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 16:32:14.460714 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:14.460676    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:32:14.461454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:14.461412    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podUID="19e716a2-f834-4286-9218-0d998953696a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 16:32:15.468487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:15.468453    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:32:15.469247 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:15.469218    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podUID="19e716a2-f834-4286-9218-0d998953696a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 16:32:16.454639 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:16.454599    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:32:16.454885 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:16.454857    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podUID="19e716a2-f834-4286-9218-0d998953696a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 16:32:17.453737 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:17.453695    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:32:17.454179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:17.453752    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podUID="19e716a2-f834-4286-9218-0d998953696a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 16:32:18.769357 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:18.769309    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:18.769808 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:18.769790    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:18.770431 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:18.770411    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk"
Oct 30 16:32:19.381261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:19.381228    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:19.912845 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:19.912815    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:20.290222 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:32:20.290144    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:32:21.444728 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:21.444697    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:21.598664 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:21.598633    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:23.050032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:23.050000    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:23.225890 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:23.225858    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:32.269656 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:32.269622    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:47.330848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.330815    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:47.829585 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.829550    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"]
Oct 30 16:32:47.839837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.839813    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.855528 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.855494    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"]
Oct 30 16:32:47.864954 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.864919    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-2e0784-openshift-default-dockercfg-4swtp\""
Oct 30 16:32:47.877040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877008    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.877172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877070    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.877227 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877201    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.877264 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877249    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.877412 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877383    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.877465 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877430    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7sqh\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-kube-api-access-q7sqh\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.877552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877533    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065cafa3-3491-45f6-97d6-c63d753d52d6-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.877610 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877580    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.877662 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.877631    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.972592 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.972557    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"]
Oct 30 16:32:47.976310 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.976288    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:47.978267 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.978242    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.978409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.978283    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.978409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.978328    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.978409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.978398    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7sqh\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-kube-api-access-q7sqh\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.978697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.978674    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065cafa3-3491-45f6-97d6-c63d753d52d6-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.978781 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.978690    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.978781 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.978704    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.979048 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.979022    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.979180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.979064    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.979180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.979138    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.979318 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.979183    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.979428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.979405    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.979984 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.979963    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065cafa3-3491-45f6-97d6-c63d753d52d6-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.981756 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.981607    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.982127 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.982086    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.982988 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.982960    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:47.991606 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:47.991581    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-ccf5c9-openshift-default-dockercfg-h2z4k\""
Oct 30 16:32:48.000861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.000829    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"]
Oct 30 16:32:48.008215 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.008173    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:48.009578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.009551    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7sqh\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-kube-api-access-q7sqh\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:48.080406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080276    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6wz6\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-kube-api-access-p6wz6\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.080406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080318    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.080652 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080455    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.080652 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080503    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.080652 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080564    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.080780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080665    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396123a-1308-4787-b783-e0a514bdae53-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.080780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080696    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.080780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080730    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.080892 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.080805    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396123a-1308-4787-b783-e0a514bdae53-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.156583 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.156552    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:48.182430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182384    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.182596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182461    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396123a-1308-4787-b783-e0a514bdae53-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.182596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182549    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6wz6\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-kube-api-access-p6wz6\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.182596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182581    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.182774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182607    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.182774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182642    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.182774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182670    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.182942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182783    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396123a-1308-4787-b783-e0a514bdae53-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.182942 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.182818    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.183956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.183610    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.184084 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.183998    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396123a-1308-4787-b783-e0a514bdae53-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.184399 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.184374    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.184704 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.184680    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.185718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.185685    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.187993 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.187973    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.188298 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.188273    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396123a-1308-4787-b783-e0a514bdae53-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.209314 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.209280    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.209975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.209950    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6wz6\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-kube-api-access-p6wz6\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.325099 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.325059    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:48.404785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.404758    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"]
Oct 30 16:32:48.408728 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.408707    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.429567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.426859    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"]
Oct 30 16:32:48.465382 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.464657    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-3e4f91-openshift-default-dockercfg-zfw6z\""
Oct 30 16:32:48.486967 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.486938    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"]
Oct 30 16:32:48.487373 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487333    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.487487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487402    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.487487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487440    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.487574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487516    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.487574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487553    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.487646 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487582    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.487684 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487662    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b826731-4760-4a92-959d-3219a4465021-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.487739 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487722    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k5qn\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-kube-api-access-8k5qn\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.487821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.487793    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b826731-4760-4a92-959d-3219a4465021-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.489789 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:32:48.489766    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065cafa3_3491_45f6_97d6_c63d753d52d6.slice/crio-593660ed4f473cc34c7fa3d711f51cedd40bd758fabf6ae6a437e53dce769f5c WatchSource:0}: Error finding container 593660ed4f473cc34c7fa3d711f51cedd40bd758fabf6ae6a437e53dce769f5c: Status 404 returned error can't find the container with id 593660ed4f473cc34c7fa3d711f51cedd40bd758fabf6ae6a437e53dce769f5c
Oct 30 16:32:48.492596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.492566    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:48.492701 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.492640    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:48.492701 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.492685    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:48.525335 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.525300    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"]
Oct 30 16:32:48.533720 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.533117    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.554421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.553572    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-063dcc-openshift-default-dockercfg-zggx2\""
Oct 30 16:32:48.554753 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.554728    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"]
Oct 30 16:32:48.589369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589289    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.589369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589321    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.589518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589480    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.589557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589535    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.589596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589572    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47t7d\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-kube-api-access-47t7d\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.589635 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589608    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.589690 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589674    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.589786 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589767    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.589786 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589780    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.589909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589809    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.589909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589836    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.589909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589866    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ee6c933-ab35-4907-a710-4040ab161613-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.589909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589895    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.590114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.589981    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.590114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.590045    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.590227 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.590121    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.590227 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.590207    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b826731-4760-4a92-959d-3219a4465021-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.590332 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.590238    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ee6c933-ab35-4907-a710-4040ab161613-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.590332 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.590285    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.590332 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.590301    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k5qn\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-kube-api-access-8k5qn\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.590524 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.590328    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b826731-4760-4a92-959d-3219a4465021-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.590524 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.590416    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.591114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.591090    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b826731-4760-4a92-959d-3219a4465021-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.592133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.592113    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.593365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.593319    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b826731-4760-4a92-959d-3219a4465021-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.615454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.615427    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k5qn\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-kube-api-access-8k5qn\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.615609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.615594    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.641814 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.641782    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"]
Oct 30 16:32:48.643301 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:32:48.643107    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd396123a_1308_4787_b783_e0a514bdae53.slice/crio-e0eb9525520f634083883dc891a34f3a2ec716321f02cc2006cf82dd4e13c728 WatchSource:0}: Error finding container e0eb9525520f634083883dc891a34f3a2ec716321f02cc2006cf82dd4e13c728: Status 404 returned error can't find the container with id e0eb9525520f634083883dc891a34f3a2ec716321f02cc2006cf82dd4e13c728
Oct 30 16:32:48.645726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.645679    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:48.645821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.645809    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:48.645907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.645888    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:48.683795 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.683769    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:48.691677 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691650    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47t7d\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-kube-api-access-47t7d\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.691848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691688    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.691848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691727    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.691848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691756    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.691848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691781    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.691848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691811    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ee6c933-ab35-4907-a710-4040ab161613-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.693272 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691913    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ee6c933-ab35-4907-a710-4040ab161613-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.693272 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691969    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.693272 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.691989    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.693272 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.692378    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.693272 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.692611    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.693272 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.692850    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.694249 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.694146    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ee6c933-ab35-4907-a710-4040ab161613-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.695279 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.695234    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.695498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.695475    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.696139 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.696120    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ee6c933-ab35-4907-a710-4040ab161613-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.718210 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.718187    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.719418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.719395    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47t7d\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-kube-api-access-47t7d\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:48.731264 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.731235    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:48.811471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.810509    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" event={"ID":"d396123a-1308-4787-b783-e0a514bdae53","Type":"ContainerStarted","Data":"b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc"}
Oct 30 16:32:48.811471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.810575    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" event={"ID":"d396123a-1308-4787-b783-e0a514bdae53","Type":"ContainerStarted","Data":"e0eb9525520f634083883dc891a34f3a2ec716321f02cc2006cf82dd4e13c728"}
Oct 30 16:32:48.836374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.830952    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" event={"ID":"065cafa3-3491-45f6-97d6-c63d753d52d6","Type":"ContainerStarted","Data":"db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2"}
Oct 30 16:32:48.836374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.831014    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" event={"ID":"065cafa3-3491-45f6-97d6-c63d753d52d6","Type":"ContainerStarted","Data":"593660ed4f473cc34c7fa3d711f51cedd40bd758fabf6ae6a437e53dce769f5c"}
Oct 30 16:32:48.848578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.848494    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:48.860521 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.858432    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podStartSLOduration=1.858413756 podStartE2EDuration="1.858413756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:32:48.857678711 +0000 UTC m=+787.910956324" watchObservedRunningTime="2026-10-30 16:32:48.858413756 +0000 UTC m=+787.911691368"
Oct 30 16:32:48.861752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:48.861730    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:49.069970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.069908    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" podStartSLOduration=2.069886964 podStartE2EDuration="2.069886964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:32:48.911072914 +0000 UTC m=+787.964350525" watchObservedRunningTime="2026-10-30 16:32:49.069886964 +0000 UTC m=+788.123164580"
Oct 30 16:32:49.076697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.076666    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"]
Oct 30 16:32:49.076814 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:32:49.076713    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b826731_4760_4a92_959d_3219a4465021.slice/crio-34989564b0bedaa43c0fd40b1653931985ba022c308a809c2c42c8cf9bbe8530 WatchSource:0}: Error finding container 34989564b0bedaa43c0fd40b1653931985ba022c308a809c2c42c8cf9bbe8530: Status 404 returned error can't find the container with id 34989564b0bedaa43c0fd40b1653931985ba022c308a809c2c42c8cf9bbe8530
Oct 30 16:32:49.079419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.079385    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:49.079509 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.079468    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:49.079583 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.079514    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:49.157403 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.157377    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:49.162884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.162861    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:49.189483 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.189392    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"]
Oct 30 16:32:49.192066 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:32:49.192032    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee6c933_ab35_4907_a710_4040ab161613.slice/crio-60f054253f6c2665512256edf725fe5d2cfbc087369d28e8b2ff3935a85b760f WatchSource:0}: Error finding container 60f054253f6c2665512256edf725fe5d2cfbc087369d28e8b2ff3935a85b760f: Status 404 returned error can't find the container with id 60f054253f6c2665512256edf725fe5d2cfbc087369d28e8b2ff3935a85b760f
Oct 30 16:32:49.194909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.194877    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:49.195051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.194942    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:49.195051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.194973    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:32:49.325664 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.325634    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:49.331286 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.331254    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:49.837651 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.837615    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" event={"ID":"9b826731-4760-4a92-959d-3219a4465021","Type":"ContainerStarted","Data":"530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1"}
Oct 30 16:32:49.838097 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.837671    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" event={"ID":"9b826731-4760-4a92-959d-3219a4465021","Type":"ContainerStarted","Data":"34989564b0bedaa43c0fd40b1653931985ba022c308a809c2c42c8cf9bbe8530"}
Oct 30 16:32:49.839261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.839233    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" event={"ID":"8ee6c933-ab35-4907-a710-4040ab161613","Type":"ContainerStarted","Data":"137df567b009af4acfcda748cf64b7c144403b2907c73145fe9dd913d9103893"}
Oct 30 16:32:49.839389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.839287    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" event={"ID":"8ee6c933-ab35-4907-a710-4040ab161613","Type":"ContainerStarted","Data":"60f054253f6c2665512256edf725fe5d2cfbc087369d28e8b2ff3935a85b760f"}
Oct 30 16:32:49.839591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.839568    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:49.839713 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.839617    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:49.840426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.840409    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:32:49.840504 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.840456    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:32:49.863056 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.863040    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:49.888228 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:49.888185    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podStartSLOduration=1.888174134 podStartE2EDuration="1.888174134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:32:49.886101627 +0000 UTC m=+788.939379237" watchObservedRunningTime="2026-10-30 16:32:49.888174134 +0000 UTC m=+788.941451744"
Oct 30 16:32:50.023825 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:50.023776    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podStartSLOduration=2.02376064 podStartE2EDuration="2.02376064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:32:50.021297858 +0000 UTC m=+789.074575482" watchObservedRunningTime="2026-10-30 16:32:50.02376064 +0000 UTC m=+789.077038294"
Oct 30 16:32:50.291934 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:32:50.291901    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:32:50.732148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:50.732109    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:50.737295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:50.737274    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:50.846047 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:50.846017    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:50.846629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:50.846611    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:32:50.868543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:50.868511    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:51.384655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:51.384605    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:51.550719 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:51.550676    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:51.724911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:51.724880    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:51.850045 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:51.850015    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:51.850972 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:51.850949    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:32:52.110118 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:52.110027    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:52.270648 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:52.270619    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:52.959972 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:52.959923    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:53.139082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:53.139040    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:53.309431 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:53.309362    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:53.826411 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:53.826381    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:54.085433 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:54.085325    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:54.286136 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:54.286100    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:54.551066 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:54.551025    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:54.695285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:54.695250    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:55.136304 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.136269    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"]
Oct 30 16:32:55.141140 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.141124    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.162065 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.162030    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"]
Oct 30 16:32:55.170256 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.170223    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-b55521-serving-cert\""
Oct 30 16:32:55.170531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.170511    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 16:32:55.170626 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.170596    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dqwfr\""
Oct 30 16:32:55.269608 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.269572    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.269803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.269619    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927813f-c8b2-443d-94b2-7722c0ab94e3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.269878 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.269856    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-metrics-certs\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.269932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.269905    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcr9k\" (UniqueName: \"kubernetes.io/projected/0927813f-c8b2-443d-94b2-7722c0ab94e3-kube-api-access-gcr9k\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.298372 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.298309    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:55.371520 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.371489    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.371678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.371539    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927813f-c8b2-443d-94b2-7722c0ab94e3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.371678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.371653    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-metrics-certs\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.371754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.371685    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcr9k\" (UniqueName: \"kubernetes.io/projected/0927813f-c8b2-443d-94b2-7722c0ab94e3-kube-api-access-gcr9k\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.372296 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.372266    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927813f-c8b2-443d-94b2-7722c0ab94e3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.374179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.374157    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-metrics-certs\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.374289 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.374162    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.395062 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.395041    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcr9k\" (UniqueName: \"kubernetes.io/projected/0927813f-c8b2-443d-94b2-7722c0ab94e3-kube-api-access-gcr9k\") pod \"maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.445824 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.445791    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:55.456243 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.456218    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:55.761388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.761360    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"]
Oct 30 16:32:55.762327 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:32:55.762301    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0927813f_c8b2_443d_94b2_7722c0ab94e3.slice/crio-c613236ad8db5c1831889345f979b8c5aa266cb1a83b621f22ca9306b3979876 WatchSource:0}: Error finding container c613236ad8db5c1831889345f979b8c5aa266cb1a83b621f22ca9306b3979876: Status 404 returned error can't find the container with id c613236ad8db5c1831889345f979b8c5aa266cb1a83b621f22ca9306b3979876
Oct 30 16:32:55.871082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:55.871044    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj" event={"ID":"0927813f-c8b2-443d-94b2-7722c0ab94e3","Type":"ContainerStarted","Data":"c613236ad8db5c1831889345f979b8c5aa266cb1a83b621f22ca9306b3979876"}
Oct 30 16:32:56.668913 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:56.668869    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:56.852220 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:56.852155    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:57.512767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:57.512660    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:57.708936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:57.708892    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:57.883145 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:57.883055    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj" event={"ID":"0927813f-c8b2-443d-94b2-7722c0ab94e3","Type":"ContainerStarted","Data":"77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad"}
Oct 30 16:32:57.883330 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:57.883158    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:32:57.928332 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:57.928267    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj" podStartSLOduration=1.4548038669999999 podStartE2EDuration="2.928251734s" totalImagesPullingTime="1.473447867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:32:57.927747693 +0000 UTC m=+796.981025304" watchObservedRunningTime="2026-10-30 16:32:57.928251734 +0000 UTC m=+796.981529346"
Oct 30 16:32:58.395717 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.395681    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:58.476931 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.476897    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"]
Oct 30 16:32:58.480764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.480744    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:32:58.498520 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.498497    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-b8ab9f\""
Oct 30 16:32:58.499556 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.499535    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"]
Oct 30 16:32:58.571963 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.571754    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:58.608314 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.608273    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd\" (UID: \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:32:58.608515 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.608489    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tglcw\" (UniqueName: \"kubernetes.io/projected/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-kube-api-access-tglcw\") pod \"payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd\" (UID: \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:32:58.611741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.611713    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"]
Oct 30 16:32:58.615941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.615919    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:32:58.635750 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.635717    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-b8ab9f-dockercfg-tk2h8\""
Oct 30 16:32:58.638027 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.638004    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"]
Oct 30 16:32:58.709989 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.709898    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs\" (UID: \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:32:58.709989 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.709944    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88qt\" (UniqueName: \"kubernetes.io/projected/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-kube-api-access-z88qt\") pod \"payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs\" (UID: \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:32:58.709989 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.709967    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tglcw\" (UniqueName: \"kubernetes.io/projected/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-kube-api-access-tglcw\") pod \"payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd\" (UID: \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:32:58.710528 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.710142    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd\" (UID: \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:32:58.710852 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.710834    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd\" (UID: \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:32:58.733951 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.733917    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tglcw\" (UniqueName: \"kubernetes.io/projected/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-kube-api-access-tglcw\") pod \"payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd\" (UID: \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:32:58.793845 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.793811    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:32:58.811416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.811389    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88qt\" (UniqueName: \"kubernetes.io/projected/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-kube-api-access-z88qt\") pod \"payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs\" (UID: \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:32:58.811552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.811537    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs\" (UID: \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:32:58.812196 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.812177    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs\" (UID: \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:32:58.834965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.834928    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88qt\" (UniqueName: \"kubernetes.io/projected/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-kube-api-access-z88qt\") pod \"payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs\" (UID: \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:32:58.936434 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:58.936397    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:32:59.136406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:59.136380    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"]
Oct 30 16:32:59.138043 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:32:59.138014    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded8b30e_d48b_46cf_8398_8f9b80f09ebc.slice/crio-6dab259b8aa5b24144e459b456e0c00f04b78b4fabf599053d29b3bd6f9a7f26 WatchSource:0}: Error finding container 6dab259b8aa5b24144e459b456e0c00f04b78b4fabf599053d29b3bd6f9a7f26: Status 404 returned error can't find the container with id 6dab259b8aa5b24144e459b456e0c00f04b78b4fabf599053d29b3bd6f9a7f26
Oct 30 16:32:59.273160 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:59.269293    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"]
Oct 30 16:32:59.277898 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:32:59.277865    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d3bc60_31d5_4cd8_9ce3_f8d78c380759.slice/crio-d15cedf257abc327b37c739561dbc840f6c749e70785ab26f60ff8d5410b8141 WatchSource:0}: Error finding container d15cedf257abc327b37c739561dbc840f6c749e70785ab26f60ff8d5410b8141: Status 404 returned error can't find the container with id d15cedf257abc327b37c739561dbc840f6c749e70785ab26f60ff8d5410b8141
Oct 30 16:32:59.669379 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:59.669331    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:59.832972 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:59.832928    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:32:59.905532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:59.905453    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd" event={"ID":"ded8b30e-d48b-46cf-8398-8f9b80f09ebc","Type":"ContainerStarted","Data":"6dab259b8aa5b24144e459b456e0c00f04b78b4fabf599053d29b3bd6f9a7f26"}
Oct 30 16:32:59.906971 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:32:59.906905    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs" event={"ID":"07d3bc60-31d5-4cd8-9ce3-f8d78c380759","Type":"ContainerStarted","Data":"d15cedf257abc327b37c739561dbc840f6c749e70785ab26f60ff8d5410b8141"}
Oct 30 16:33:00.427697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.427662    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:00.594425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.594323    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:00.671682 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.671189    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"]
Oct 30 16:33:00.678723 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.678613    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:00.693540 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.693511    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"]
Oct 30 16:33:00.700801 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.700776    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-3e4f91\""
Oct 30 16:33:00.701730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.701711    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-3e4f91-dockercfg-cwl2f\""
Oct 30 16:33:00.736218 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.736176    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz\" (UID: \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:00.736437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.736271    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llntn\" (UniqueName: \"kubernetes.io/projected/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-kube-api-access-llntn\") pod \"payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz\" (UID: \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:00.837641 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.837602    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz\" (UID: \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:00.838124 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.837660    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llntn\" (UniqueName: \"kubernetes.io/projected/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-kube-api-access-llntn\") pod \"payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz\" (UID: \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:00.838612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.838566    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz\" (UID: \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:00.871470 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.871438    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llntn\" (UniqueName: \"kubernetes.io/projected/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-kube-api-access-llntn\") pod \"payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz\" (UID: \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:00.996288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:00.996100    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:01.371603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:01.370313    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"]
Oct 30 16:33:01.941791 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:01.941750    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz" event={"ID":"d9783b72-9bb5-43f0-845c-6a92a79cbdf5","Type":"ContainerStarted","Data":"9586d0d928c2771b6998819999546513f9fd47e5c2e31d91c4eaa55f26b65f23"}
Oct 30 16:33:02.180396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:02.180356    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:02.340323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:02.340239    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:02.974393 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:02.974352    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs" event={"ID":"07d3bc60-31d5-4cd8-9ce3-f8d78c380759","Type":"ContainerStarted","Data":"5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809"}
Oct 30 16:33:02.974875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:02.974425    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:33:02.976105 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:02.976081    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd" event={"ID":"ded8b30e-d48b-46cf-8398-8f9b80f09ebc","Type":"ContainerStarted","Data":"f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9"}
Oct 30 16:33:02.976217 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:02.976205    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:33:03.017281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:03.017214    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs" podStartSLOduration=1.488915516 podStartE2EDuration="5.017196584s" totalImagesPullingTime="3.528281068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:03.016683871 +0000 UTC m=+802.069961482" watchObservedRunningTime="2026-10-30 16:33:03.017196584 +0000 UTC m=+802.070474198"
Oct 30 16:33:03.899263 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:03.899236    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:33:03.942824 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:03.942774    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd" podStartSLOduration=2.240642508 podStartE2EDuration="5.94275935s" totalImagesPullingTime="3.702116842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:03.068789919 +0000 UTC m=+802.122067530" watchObservedRunningTime="2026-10-30 16:33:03.94275935 +0000 UTC m=+802.996036970"
Oct 30 16:33:03.984527 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:03.984491    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz" event={"ID":"d9783b72-9bb5-43f0-845c-6a92a79cbdf5","Type":"ContainerStarted","Data":"60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28"}
Oct 30 16:33:03.984970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:03.984760    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:04.047848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:04.047785    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz" podStartSLOduration=2.18922983 podStartE2EDuration="4.047749253s" totalImagesPullingTime="1.858519423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:04.045560066 +0000 UTC m=+803.098837678" watchObservedRunningTime="2026-10-30 16:33:04.047749253 +0000 UTC m=+803.101026866"
Oct 30 16:33:04.166669 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:04.166586    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:05.881504 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:05.881461    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:33:05.882020 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:05.881522    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:33:06.367240 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:06.367158    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:06.534538 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:06.534500    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:06.692187 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:06.688159    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:06.838471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:06.838443    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:07.003022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.002927    5101 generic.go:356] "Generic (PLEG): container finished" podID="d396123a-1308-4787-b783-e0a514bdae53" containerID="b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc" exitCode=0
Oct 30 16:33:07.003022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.002997    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" event={"ID":"d396123a-1308-4787-b783-e0a514bdae53","Type":"ContainerDied","Data":"b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc"}
Oct 30 16:33:07.003464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.003439    5101 scope.go:122] "RemoveContainer" containerID="b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc"
Oct 30 16:33:07.004855 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.004831    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:07.004927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.004892    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:07.004962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.004924    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:07.016683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.016652    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:07.187753 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.187598    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:07.371417 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:07.370569    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:08.020931 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.020900    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" event={"ID":"d396123a-1308-4787-b783-e0a514bdae53","Type":"ContainerStarted","Data":"0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f"}
Oct 30 16:33:08.326188 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.326088    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:33:08.326392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.326327    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 16:33:08.326489 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.326393    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 16:33:08.792359 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.792218    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"]
Oct 30 16:33:08.799530 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.799502    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.816060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.815916    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"]
Oct 30 16:33:08.820847 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.819897    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-metrics-certs\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.820847 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.819939    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ggw\" (UniqueName: \"kubernetes.io/projected/6e722e81-9a86-4329-ba68-3f409245dd65-kube-api-access-h7ggw\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.820847 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.820090    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.820847 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.820140    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e722e81-9a86-4329-ba68-3f409245dd65-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.903009 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.902597    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-b8ab9f-serving-cert\""
Oct 30 16:33:08.921789 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.921760    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-metrics-certs\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.921956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.921800    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ggw\" (UniqueName: \"kubernetes.io/projected/6e722e81-9a86-4329-ba68-3f409245dd65-kube-api-access-h7ggw\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.921956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.921835    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.921956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.921866    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e722e81-9a86-4329-ba68-3f409245dd65-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.922533 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.922509    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e722e81-9a86-4329-ba68-3f409245dd65-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.924644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.924620    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.926191 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.926166    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-metrics-certs\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:08.936143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:08.935713    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:09.005361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:09.005114    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ggw\" (UniqueName: \"kubernetes.io/projected/6e722e81-9a86-4329-ba68-3f409245dd65-kube-api-access-h7ggw\") pod \"maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:09.116094 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:09.116014    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:09.169366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:09.168889    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:09.332285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:09.326486    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 16:33:09.332285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:09.326548    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 16:33:09.515664 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:09.515628    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"]
Oct 30 16:33:10.038588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:10.038548    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt" event={"ID":"6e722e81-9a86-4329-ba68-3f409245dd65","Type":"ContainerStarted","Data":"a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640"}
Oct 30 16:33:10.038753 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:10.038621    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:10.038753 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:10.038645    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt" event={"ID":"6e722e81-9a86-4329-ba68-3f409245dd65","Type":"ContainerStarted","Data":"12c762f87abc414944f72b5c862dc5ca345ed8cb3dfb6ad3f071160d669d5ade"}
Oct 30 16:33:10.126874 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:10.126804    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt" podStartSLOduration=1.751384482 podStartE2EDuration="2.126787787s" totalImagesPullingTime="375.403305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:10.126116533 +0000 UTC m=+809.179394145" watchObservedRunningTime="2026-10-30 16:33:10.126787787 +0000 UTC m=+809.180065435"
Oct 30 16:33:10.325787 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:10.325697    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 16:33:10.325787 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:10.325757    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 16:33:11.113768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.113734    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"]
Oct 30 16:33:11.127504 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.127467    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.197363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.179848    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"]
Oct 30 16:33:11.209736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.205253    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/201c113a-cdd6-44bd-852a-0b530655ac7d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.209736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.205457    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9xfn\" (UniqueName: \"kubernetes.io/projected/201c113a-cdd6-44bd-852a-0b530655ac7d-kube-api-access-b9xfn\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.209736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.205529    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-metrics-certs\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.209736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.205620    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.210537 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.210513    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-3e4f91-serving-cert\""
Oct 30 16:33:11.296025 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.295989    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:11.306199 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.306167    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9xfn\" (UniqueName: \"kubernetes.io/projected/201c113a-cdd6-44bd-852a-0b530655ac7d-kube-api-access-b9xfn\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.306389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.306208    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-metrics-certs\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.306389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.306244    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.306389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.306308    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/201c113a-cdd6-44bd-852a-0b530655ac7d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.307133 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:33:11.306909    5101 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-serving-cert: secret "maas-api-e2e-worker-w2-3e4f91-serving-cert" not found
Oct 30 16:33:11.307133 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:33:11.306970    5101 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls podName:201c113a-cdd6-44bd-852a-0b530655ac7d nodeName:}" failed. No retries permitted until 2026-10-30 16:33:11.80695573 +0000 UTC m=+810.860233331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls") pod "maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l" (UID: "201c113a-cdd6-44bd-852a-0b530655ac7d") : secret "maas-api-e2e-worker-w2-3e4f91-serving-cert" not found
Oct 30 16:33:11.307133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.307114    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/201c113a-cdd6-44bd-852a-0b530655ac7d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.310112 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.310085    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-metrics-certs\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.325563 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.325534    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 16:33:11.325653 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.325596    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 16:33:11.337170 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.337137    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9xfn\" (UniqueName: \"kubernetes.io/projected/201c113a-cdd6-44bd-852a-0b530655ac7d-kube-api-access-b9xfn\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.485104 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.485068    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:11.640770 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.640701    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:11.801422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.798863    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:11.813000 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.812955    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:11.819290 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:11.816247    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:12.054547 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:12.046532    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:12.132208 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:12.132149    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:12.311173 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:12.305322    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:12.326249 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:12.326213    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 16:33:12.326559 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:12.326530    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 16:33:12.505867 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:12.505830    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:12.524389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:12.524333    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"]
Oct 30 16:33:12.525748 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:33:12.525719    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201c113a_cdd6_44bd_852a_0b530655ac7d.slice/crio-dc4ac43d4486c37f608b88f578ffd34d4754dd14ab6681b18107a2eb801aced3 WatchSource:0}: Error finding container dc4ac43d4486c37f608b88f578ffd34d4754dd14ab6681b18107a2eb801aced3: Status 404 returned error can't find the container with id dc4ac43d4486c37f608b88f578ffd34d4754dd14ab6681b18107a2eb801aced3
Oct 30 16:33:13.119612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:13.119579    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l" event={"ID":"201c113a-cdd6-44bd-852a-0b530655ac7d","Type":"ContainerStarted","Data":"dc4ac43d4486c37f608b88f578ffd34d4754dd14ab6681b18107a2eb801aced3"}
Oct 30 16:33:13.325722 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:13.325630    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 16:33:13.325722 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:13.325700    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 16:33:13.433245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:13.433207    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:13.987820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:13.987783    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:33:13.988042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:13.987971    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:33:14.132203 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:14.132160    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l" event={"ID":"201c113a-cdd6-44bd-852a-0b530655ac7d","Type":"ContainerStarted","Data":"49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4"}
Oct 30 16:33:14.132415 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:14.132258    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:14.204212 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:14.204143    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l" podStartSLOduration=2.8172820610000002 podStartE2EDuration="3.204123735s" totalImagesPullingTime="386.841674ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:14.200356243 +0000 UTC m=+813.253633851" watchObservedRunningTime="2026-10-30 16:33:14.204123735 +0000 UTC m=+813.257401348"
Oct 30 16:33:14.330075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:14.330004    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:33:14.330536 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:14.330378    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:33:14.331261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:14.331241    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:33:14.994410 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:14.994369    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:33:15.369689 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:15.369554    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:15.520503 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:15.520459    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:15.672852 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:15.672765    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:16.095470 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:16.094588    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:33:17.206170 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:17.206135    5101 generic.go:356] "Generic (PLEG): container finished" podID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerID="db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2" exitCode=0
Oct 30 16:33:17.206818 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:17.206210    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" event={"ID":"065cafa3-3491-45f6-97d6-c63d753d52d6","Type":"ContainerDied","Data":"db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2"}
Oct 30 16:33:17.206818 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:17.206745    5101 scope.go:122] "RemoveContainer" containerID="db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2"
Oct 30 16:33:17.208281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:17.208249    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:17.208374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:17.208353    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:17.208432 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:17.208416    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:17.566236 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:17.565876    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:18.065157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:18.065081    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:18.206568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:18.206502    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:18.214921 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:18.214889    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" event={"ID":"065cafa3-3491-45f6-97d6-c63d753d52d6","Type":"ContainerStarted","Data":"f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813"}
Oct 30 16:33:19.163130 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:19.163097    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:33:19.163543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:19.163517    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:33:19.163726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:19.163702    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 16:33:19.691364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:19.690583    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:19.839726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:19.839696    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:33:20.177801 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:20.173513    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:33:20.177801 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:20.174526    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:33:20.177801 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:20.174573    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 16:33:20.368523 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:33:20.345908    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:33:21.163777 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:21.163734    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:33:21.164412 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:21.164374    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 16:33:21.798752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:21.798645    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:21.852137 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:21.851776    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:33:21.852137 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:21.851837    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 16:33:21.976821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:21.976736    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:22.159215 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.158778    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:33:22.159215 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.158840    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 16:33:22.239990 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.239956    5101 generic.go:356] "Generic (PLEG): container finished" podID="8ee6c933-ab35-4907-a710-4040ab161613" containerID="137df567b009af4acfcda748cf64b7c144403b2907c73145fe9dd913d9103893" exitCode=0
Oct 30 16:33:22.240401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.240036    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" event={"ID":"8ee6c933-ab35-4907-a710-4040ab161613","Type":"ContainerDied","Data":"137df567b009af4acfcda748cf64b7c144403b2907c73145fe9dd913d9103893"}
Oct 30 16:33:22.240581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.240561    5101 scope.go:122] "RemoveContainer" containerID="137df567b009af4acfcda748cf64b7c144403b2907c73145fe9dd913d9103893"
Oct 30 16:33:22.241948 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.241921    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:22.242007 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.241994    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:22.242046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.242026    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:22.422458 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.420143    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:22.572843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.572797    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:22.728628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:22.728553    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:23.159372 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:23.157439    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:33:23.159372 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:23.157497    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 16:33:23.294767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:23.283985    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" event={"ID":"8ee6c933-ab35-4907-a710-4040ab161613","Type":"ContainerStarted","Data":"5a82009f38ad520dcb5db7a0cb743a80b9d72609393a07b7b5a42f7a4618394a"}
Oct 30 16:33:23.357005 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:23.356822    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:23.865363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:23.864679    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:33:23.865363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:23.864802    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:33:23.865363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:23.864844    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 16:33:24.170236 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:24.170203    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:33:24.171734 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:24.171706    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:33:24.191294 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:24.191264    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:24.865359 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:24.865096    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:33:24.865359 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:24.865178    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 16:33:25.864363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:25.863762    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:33:25.864363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:25.863827    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 16:33:26.107641 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:26.107590    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:26.864363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:26.862743    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:33:26.864363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:26.862811    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 16:33:27.315789 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.315754    5101 generic.go:356] "Generic (PLEG): container finished" podID="9b826731-4760-4a92-959d-3219a4465021" containerID="530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1" exitCode=0
Oct 30 16:33:27.316158 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.315826    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" event={"ID":"9b826731-4760-4a92-959d-3219a4465021","Type":"ContainerDied","Data":"530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1"}
Oct 30 16:33:27.316253 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.316234    5101 scope.go:122] "RemoveContainer" containerID="530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1"
Oct 30 16:33:27.317567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.317537    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:27.317674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.317620    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:27.317674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.317668    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:33:27.866366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.865740    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:33:27.866366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.865803    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 16:33:27.906414 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:27.906367    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:28.069297 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.069234    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:28.325550 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.325514    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" event={"ID":"9b826731-4760-4a92-959d-3219a4465021","Type":"ContainerStarted","Data":"00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2"}
Oct 30 16:33:28.329022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.328997    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:28.639405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.639283    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:28.732208 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.732172    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:33:28.732528 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.732504    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:33:28.732582 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.732560    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 16:33:28.783206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.783170    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:28.938232 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.938197    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:28.962189 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.960647    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:33:28.962189 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.962028    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:33:28.977395 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:28.976810    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:33:29.731869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:29.731835    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:33:29.732281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:29.731890    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 16:33:30.482196 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:30.482159    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:30.732082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:30.732042    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:33:30.732552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:30.732109    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 16:33:31.685975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:31.685924    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:31.731987 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:31.731952    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:33:31.732181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:31.732044    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 16:33:31.828311 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:31.828266    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:32.414186 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:32.414145    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:32.571508 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:32.571474    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:32.732769 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:32.732680    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:33:32.733137 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:32.732765    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 16:33:33.204563 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:33.204501    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:33.376172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:33.376129    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:33.840725 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:33.840686    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:33.966773 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:33.966740    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:33:33.967232 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:33.967200    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:33:33.968205 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:33.968183    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:33:34.003527 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:34.003496    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:34.163294 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:34.163252    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:34.371176 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:34.371140    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:34.819503 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:34.819469    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:36.341988 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:36.341937    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:38.244495 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:38.244454    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:38.398281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:38.398239    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:39.062009 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:39.061970    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:39.210492 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:39.210463    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:39.364567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:39.364485    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:40.057523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:40.057493    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:40.209154 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:40.209095    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:41.815619 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:41.815550    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:43.661737 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:43.661658    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:44.145455 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:44.145418    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:45.463559 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:45.463525    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:47.309517 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:47.309482    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:48.985629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:48.985594    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:49.440266 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:49.440217    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:50.292676 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:33:50.292612    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:33:50.734862 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:50.734820    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:52.551535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:52.551506    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:52.700598 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:52.700566    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:53.745876 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:53.745848    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:54.295855 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:54.295824    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:56.048761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:56.048726    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:57.799637 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:57.799599    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:33:59.609959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:33:59.609901    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:01.391518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:01.391487    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:01.927431 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:01.927390    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:02.085025 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:02.084987    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:03.216235 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:03.216196    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:04.924352 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:04.924313    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:06.729186 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:06.729153    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:08.473094 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:08.473061    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:10.231614 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:10.231564    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:12.143950 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:12.143915    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:13.922385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:13.922354    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:15.543050 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:15.543010    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:16.697192 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:16.697162    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:17.339996 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.339962    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:17.940728 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.940693    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"]
Oct 30 16:34:17.945706 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.945683    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.960950 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.960931    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-b55521-openshift-default-dockercfg-wtvp5\""
Oct 30 16:34:17.975524 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.975499    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"]
Oct 30 16:34:17.977030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977003    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.977142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977115    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.977142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977135    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.977261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977154    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.977261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977218    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.977437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977414    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.977506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977466    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45f8t\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-kube-api-access-45f8t\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.977563 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977536    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e9e77a-a23f-424d-914d-a44d465dc23a-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:17.977563 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:17.977556    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.078952 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.078924    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079107 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.078955    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079107 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.078977    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079107 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079084    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079189    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079245    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45f8t\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-kube-api-access-45f8t\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079394 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079287    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e9e77a-a23f-424d-914d-a44d465dc23a-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079394 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079317    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079396    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079450    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079316    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079639 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079532    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079639 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079566    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.079952 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.079930    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e9e77a-a23f-424d-914d-a44d465dc23a-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.081670 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.081651    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.082100 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.082083    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.103010 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.102982    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.103193 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.103175    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45f8t\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-kube-api-access-45f8t\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.259576 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.259501    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:18.577748 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.577715    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"]
Oct 30 16:34:18.579529 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:34:18.579506    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e9e77a_a23f_424d_914d_a44d465dc23a.slice/crio-d90eb5a5d5de18f70a53d25ef74aaa8bc382c75326d68be12dc8aa2a573bba94 WatchSource:0}: Error finding container d90eb5a5d5de18f70a53d25ef74aaa8bc382c75326d68be12dc8aa2a573bba94: Status 404 returned error can't find the container with id d90eb5a5d5de18f70a53d25ef74aaa8bc382c75326d68be12dc8aa2a573bba94
Oct 30 16:34:18.581838 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.581808    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:34:18.581902 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.581871    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:34:18.581939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.581900    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:34:18.647409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.647385    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" event={"ID":"65e9e77a-a23f-424d-914d-a44d465dc23a","Type":"ContainerStarted","Data":"5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3"}
Oct 30 16:34:18.647502 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.647436    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" event={"ID":"65e9e77a-a23f-424d-914d-a44d465dc23a","Type":"ContainerStarted","Data":"d90eb5a5d5de18f70a53d25ef74aaa8bc382c75326d68be12dc8aa2a573bba94"}
Oct 30 16:34:18.693500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:18.693451    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podStartSLOduration=1.693438675 podStartE2EDuration="1.693438675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:34:18.691425481 +0000 UTC m=+877.744703092" watchObservedRunningTime="2026-10-30 16:34:18.693438675 +0000 UTC m=+877.746716323"
Oct 30 16:34:19.168492 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:19.168455    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:19.264401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:19.264366    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:19.269956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:19.269920    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:34:19.270245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:19.270217    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 16:34:19.312501 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:19.312467    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:20.263362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:20.262757    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:34:20.263362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:20.262816    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 16:34:20.294920 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:34:20.294889    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:34:21.074360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:21.064229    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:21.262365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:21.261707    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:34:21.262365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:21.261771    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 16:34:22.264749 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:22.264713    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:34:22.265315 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:22.265287    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 16:34:23.055466 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:23.055404    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:23.263739 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:23.263699    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:34:23.264030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:23.264003    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 16:34:24.263730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:24.263255    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:34:24.263730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:24.263321    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 16:34:24.834551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:24.834495    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:25.264926 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:25.264898    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:25.265323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:25.265163    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:25.265771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:25.265754    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:34:26.550349 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:26.550296    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:26.919449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:26.919407    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:28.445074 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:28.445030    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:29.328054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:29.328023    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:30.139488 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:30.139457    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:31.851469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:31.851433    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:32.532331 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:32.532296    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:33.550859 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:33.550820    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:35.296815 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:35.296774    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:37.246430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:37.246392    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:39.049098 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:39.049057    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:41.018075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:41.018036    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:41.190811 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:41.190785    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:34:41.193088 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:41.193067    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:34:41.194010 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:41.193989    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:34:41.196380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:41.196353    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:34:42.772257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:42.772218    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:44.663800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:44.663762    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:46.414446 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:46.414407    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:48.230619 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.230583    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:48.624091 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.624012    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"]
Oct 30 16:34:48.629385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.629362    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.648373 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.648335    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-b8ab9f-openshift-default-dockercfg-lh4z4\""
Oct 30 16:34:48.654877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.654852    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.654997 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.654891    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb69f0da-4c6f-4cec-b805-52e1f730140d-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.654997 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.654922    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.655086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.655062    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.655152 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.655136    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.655247 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.655218    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.655309 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.655293    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.655379 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.655351    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2sm\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-kube-api-access-cj2sm\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.655498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.655478    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.664331 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.664305    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"]
Oct 30 16:34:48.756472 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756443    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756472 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756473    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb69f0da-4c6f-4cec-b805-52e1f730140d-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756663 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756495    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756663 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756512    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756663 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756561    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756663 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756590    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756836 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756750    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756836 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756804    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2sm\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-kube-api-access-cj2sm\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756943 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756844    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.756943 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756886    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.757054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.756987    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.757140 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.757115    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.757291 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.757271    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb69f0da-4c6f-4cec-b805-52e1f730140d-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.757386 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.757271    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.758881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.758857    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.758998 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.758965    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.780028 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.780005    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.780204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.780185    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2sm\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-kube-api-access-cj2sm\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:48.942242 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:48.942211    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:49.281396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:49.281366    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"]
Oct 30 16:34:49.281756 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:34:49.281476    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb69f0da_4c6f_4cec_b805_52e1f730140d.slice/crio-16c134e9b8c693fe775c036d02cc1aed4b1cc5e6601ca2f1ae47b91c675f7de8 WatchSource:0}: Error finding container 16c134e9b8c693fe775c036d02cc1aed4b1cc5e6601ca2f1ae47b91c675f7de8: Status 404 returned error can't find the container with id 16c134e9b8c693fe775c036d02cc1aed4b1cc5e6601ca2f1ae47b91c675f7de8
Oct 30 16:34:49.283644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:49.283609    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:34:49.283752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:49.283688    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:34:49.283752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:49.283728    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:34:49.835840 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:49.835802    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" event={"ID":"eb69f0da-4c6f-4cec-b805-52e1f730140d","Type":"ContainerStarted","Data":"69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3"}
Oct 30 16:34:49.836043 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:49.835859    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" event={"ID":"eb69f0da-4c6f-4cec-b805-52e1f730140d","Type":"ContainerStarted","Data":"16c134e9b8c693fe775c036d02cc1aed4b1cc5e6601ca2f1ae47b91c675f7de8"}
Oct 30 16:34:49.922288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:49.922236    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" podStartSLOduration=1.9222209970000002 podStartE2EDuration="1.922220997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:34:49.909100718 +0000 UTC m=+908.962378332" watchObservedRunningTime="2026-10-30 16:34:49.922220997 +0000 UTC m=+908.975498607"
Oct 30 16:34:49.963361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:49.962521    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:50.026693 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:50.026656    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:50.299258 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:34:50.299219    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:34:50.966484 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:50.966439    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:34:50.966753 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:50.966723    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 16:34:51.872010 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:51.871965    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:51.951362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:51.949841    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:34:51.951362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:51.949913    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 16:34:52.965362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:52.964687    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:34:52.965362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:52.964744    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 16:34:53.725321 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:53.725291    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:53.951688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:53.951653    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:34:53.951961 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:53.951933    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 16:34:54.945759 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:54.945721    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:34:54.946363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:54.946310    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 16:34:56.068542 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:56.068507    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:56.705115 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:56.705085    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:56.705570 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:56.705541    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:56.706441 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:56.706418    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:34:57.670549 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:57.670503    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:58.556304 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:58.556277    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:34:59.640608 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:34:59.640577    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:01.801248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:01.801203    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:03.524966 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.524934    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"]
Oct 30 16:35:03.529061 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.529042    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.547162 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.547137    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-a7610c-openshift-default-dockercfg-8hbdj\""
Oct 30 16:35:03.563193 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.563159    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"]
Oct 30 16:35:03.617975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.617950    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:03.628543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628487    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.629054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628566    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.629054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628620    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/588f354f-5e74-4a4e-a482-285991ec20a6-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.629054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628663    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.629054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628690    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.629054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628750    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47dsk\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-kube-api-access-47dsk\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.629054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628778    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.629054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628807    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.629054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.628835    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/588f354f-5e74-4a4e-a482-285991ec20a6-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730081 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730051    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730101    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730275    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/588f354f-5e74-4a4e-a482-285991ec20a6-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730301    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730320    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730379    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47dsk\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-kube-api-access-47dsk\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730547 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730507    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730614 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730546    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730614 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730569    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730746 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730519    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730746 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730613    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/588f354f-5e74-4a4e-a482-285991ec20a6-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730746 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730702    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.730918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.730903    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.731205 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.731184    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/588f354f-5e74-4a4e-a482-285991ec20a6-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.732689 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.732665    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.732779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.732741    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/588f354f-5e74-4a4e-a482-285991ec20a6-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.759910 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.759883    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.760232 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.760209    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47dsk\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-kube-api-access-47dsk\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:03.843032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:03.842916    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:04.176780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:04.176754    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"]
Oct 30 16:35:04.178019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:04.177990    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:04.178105 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:04.178048    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:04.178105 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:04.178075    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:04.969364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:04.969291    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" event={"ID":"588f354f-5e74-4a4e-a482-285991ec20a6","Type":"ContainerStarted","Data":"5dc244d9b7703d53d734f6ad77b82d9e047aba026ad5cf1e2060a68338f52987"}
Oct 30 16:35:04.969780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:04.969374    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" event={"ID":"588f354f-5e74-4a4e-a482-285991ec20a6","Type":"ContainerStarted","Data":"538b24c72f410c5f24059f78bfda402ec6a26ac0bc425003948b550535c4a5dc"}
Oct 30 16:35:05.029771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:05.029703    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" podStartSLOduration=2.029684534 podStartE2EDuration="2.029684534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:05.028237126 +0000 UTC m=+924.081514736" watchObservedRunningTime="2026-10-30 16:35:05.029684534 +0000 UTC m=+924.082962144"
Oct 30 16:35:05.585288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:05.585243    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:05.863414 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:05.848631    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:05.867462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:05.867429    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:35:05.867570 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:05.867494    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 16:35:06.867504 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:06.867467    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:35:06.867994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:06.867529    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 16:35:07.394273 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:07.394216    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:07.867437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:07.864734    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:35:07.867437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:07.864800    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 16:35:08.860853 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:08.847681    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:35:08.860853 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:08.847755    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 16:35:09.161364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:09.160828    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:09.843737 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:09.843700    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:35:09.844041 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:09.844011    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 16:35:11.372415 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:11.371535    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:11.373637 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:11.373474    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:11.375295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:11.375245    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:35:11.504352 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:11.504297    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:13.429274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:13.429224    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:15.206008 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:15.205974    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:17.040430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.040394    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:17.388961 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.388888    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"]
Oct 30 16:35:17.394244 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.394222    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.411601 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.411576    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"]
Oct 30 16:35:17.421229 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.421207    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"default-dockercfg-j6fvc\""
Oct 30 16:35:17.421369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.421208    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"distinct-w6-063dcc-kserve-self-signed-certs\""
Oct 30 16:35:17.421369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.421275    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"openshift-service-ca.crt\""
Oct 30 16:35:17.421561 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.421539    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"kube-root-ca.crt\""
Oct 30 16:35:17.487799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.487768    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tls-certs\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.487929 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.487829    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6ck4\" (UniqueName: \"kubernetes.io/projected/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-kube-api-access-k6ck4\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.487929 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.487917    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tmp-dir\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.488031 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.487966    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-dshm\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.488080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.488063    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-home\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.488163 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.488148    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-model-cache\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.488624 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.488604    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:17.589436 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.589400    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-model-cache\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.595490    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tls-certs\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.595575    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6ck4\" (UniqueName: \"kubernetes.io/projected/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-kube-api-access-k6ck4\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.595618    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tmp-dir\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.595677    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-dshm\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.595735    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-home\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.596421    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-home\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.590008    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-model-cache\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.597515    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tmp-dir\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.600387    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-dshm\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.601588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.600632    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tls-certs\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.622408 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.622375    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6ck4\" (UniqueName: \"kubernetes.io/projected/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-kube-api-access-k6ck4\") pod \"distinct-w6-063dcc-kserve-78f8b44656-kp2qg\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:17.708410 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:17.708384    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:18.012684 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.012658    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"]
Oct 30 16:35:18.012811 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:35:18.012714    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fc7c872_ab93_48ad_ad9a_bbdef04b79d5.slice/crio-91278a8911ba1f00b92ea48ddc33dbe1445aa24d48def37dcf1fbd742c8025fe WatchSource:0}: Error finding container 91278a8911ba1f00b92ea48ddc33dbe1445aa24d48def37dcf1fbd742c8025fe: Status 404 returned error can't find the container with id 91278a8911ba1f00b92ea48ddc33dbe1445aa24d48def37dcf1fbd742c8025fe
Oct 30 16:35:18.070947 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.070920    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" event={"ID":"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5","Type":"ContainerStarted","Data":"91278a8911ba1f00b92ea48ddc33dbe1445aa24d48def37dcf1fbd742c8025fe"}
Oct 30 16:35:18.120202 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.120119    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"]
Oct 30 16:35:18.124204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.124181    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.154524 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.154499    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"]
Oct 30 16:35:18.202670 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.202637    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.202812 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.202744    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.202812 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.202770    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv88s\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-kube-api-access-cv88s\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.202888 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.202854    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.202888 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.202874    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.202971 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.202955    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.203005 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.202980    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.203040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.203014    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.203072 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.203046    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304202 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304122    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304202 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304182    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304238    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304263    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv88s\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-kube-api-access-cv88s\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304329    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304370    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304424    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304455    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304495    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304558    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304602    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.304926 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304877    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.305010 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.304986    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.305280 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.305260    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.306831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.306805    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.306935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.306883    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.333556 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.333530    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.333651 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.333583    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv88s\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-kube-api-access-cv88s\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.439120 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.439081    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:18.760561 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.760534    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"]
Oct 30 16:35:18.762806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.762771    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:18.762916 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.762834    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:18.762916 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.762861    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:18.841234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:18.841207    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:19.080580 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.080499    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" event={"ID":"7ae181cf-abfa-4494-a1b2-161bb76d22ca","Type":"ContainerStarted","Data":"bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57"}
Oct 30 16:35:19.080580 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.080558    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" event={"ID":"7ae181cf-abfa-4494-a1b2-161bb76d22ca","Type":"ContainerStarted","Data":"9ad94ee61c62f2249dade457f4300dbb4c13c9afb2684719f500304b5da43ca7"}
Oct 30 16:35:19.082667 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.082637    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" event={"ID":"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5","Type":"ContainerStarted","Data":"f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740"}
Oct 30 16:35:19.151367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.151273    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podStartSLOduration=1.151257425 podStartE2EDuration="1.151257425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:19.136873431 +0000 UTC m=+938.190151043" watchObservedRunningTime="2026-10-30 16:35:19.151257425 +0000 UTC m=+938.204535096"
Oct 30 16:35:19.178460 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.178407    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podStartSLOduration=2.178392856 podStartE2EDuration="2.178392856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:19.178054239 +0000 UTC m=+938.231331849" watchObservedRunningTime="2026-10-30 16:35:19.178392856 +0000 UTC m=+938.231670465"
Oct 30 16:35:19.439825 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.439787    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:19.441424 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.441400    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:35:19.441546 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.441452    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 16:35:19.709616 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:19.709536    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:20.294765 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:35:20.294733    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:35:20.440413 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:20.440372    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:35:20.440574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:20.440430    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 16:35:20.767463 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:20.761310    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:21.440422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:21.440387    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:35:21.440819 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:21.440458    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 16:35:22.439430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:22.439398    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:35:22.439601 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:22.439449    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 16:35:22.734986 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:22.734882    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:23.439795 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:23.439723    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:35:23.439795 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:23.439766    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 16:35:24.439404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:24.439372    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:35:24.439797 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:24.439418    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 16:35:24.601280 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:24.601235    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:26.207852 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:26.207819    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:26.226381 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:26.225351    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:26.236697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:26.236664    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:35:26.912938 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:26.912905    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:27.709516 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:27.709489    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:27.721307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:27.721284    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:28.231818 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:28.231787    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:35:28.666695 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:28.666660    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:30.358294 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:30.358259    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:32.247927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:32.247880    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:32.649644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:32.649613    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:34.002171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:34.002112    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:35.821717 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:35.821683    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:37.556454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:37.556424    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:39.168151 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.168109    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:39.397110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.397080    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"]
Oct 30 16:35:39.401604 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.401582    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.433101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.433029    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-3e4f91\"/\"openshift-service-ca.crt\""
Oct 30 16:35:39.433101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.433029    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-3e4f91\"/\"distinct-w2-3e4f91-kserve-self-signed-certs\""
Oct 30 16:35:39.433101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.433031    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-3e4f91\"/\"default-dockercfg-cd44t\""
Oct 30 16:35:39.433302 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.433148    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-3e4f91\"/\"kube-root-ca.crt\""
Oct 30 16:35:39.437521 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.437500    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"]
Oct 30 16:35:39.490452 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.490426    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dvgz\" (UniqueName: \"kubernetes.io/projected/972f1924-be45-45b9-bede-b0b6416224c3-kube-api-access-7dvgz\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.490596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.490509    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/972f1924-be45-45b9-bede-b0b6416224c3-tls-certs\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.490662 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.490625    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-dshm\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.490720 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.490682    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-tmp-dir\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.490806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.490779    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-model-cache\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.490873 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.490855    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-home\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.512963 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.512933    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:39.593129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.593087    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-home\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.593324 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.593166    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dvgz\" (UniqueName: \"kubernetes.io/projected/972f1924-be45-45b9-bede-b0b6416224c3-kube-api-access-7dvgz\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.593324 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.593267    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/972f1924-be45-45b9-bede-b0b6416224c3-tls-certs\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.593464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.593371    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-dshm\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.593464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.593450    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-tmp-dir\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.593555 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.593484    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-model-cache\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.593885 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.593863    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-model-cache\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.594117 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.594098    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-home\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.595514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.595209    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-tmp-dir\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.611378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.598399    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-dshm\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.611378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.610485    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/972f1924-be45-45b9-bede-b0b6416224c3-tls-certs\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.621655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.621628    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dvgz\" (UniqueName: \"kubernetes.io/projected/972f1924-be45-45b9-bede-b0b6416224c3-kube-api-access-7dvgz\") pod \"distinct-w2-3e4f91-kserve-54f8b68c-c89jp\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") " pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:39.715901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:39.715819    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:40.015990 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:35:40.015965    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod972f1924_be45_45b9_bede_b0b6416224c3.slice/crio-aef54ce9be60172bed60c0fb70fcef52a832c0d495fd73c836a5db1b8e3c8725 WatchSource:0}: Error finding container aef54ce9be60172bed60c0fb70fcef52a832c0d495fd73c836a5db1b8e3c8725: Status 404 returned error can't find the container with id aef54ce9be60172bed60c0fb70fcef52a832c0d495fd73c836a5db1b8e3c8725
Oct 30 16:35:40.016376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.016351    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"]
Oct 30 16:35:40.294364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.294265    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" event={"ID":"972f1924-be45-45b9-bede-b0b6416224c3","Type":"ContainerStarted","Data":"5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db"}
Oct 30 16:35:40.294364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.294307    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" event={"ID":"972f1924-be45-45b9-bede-b0b6416224c3","Type":"ContainerStarted","Data":"aef54ce9be60172bed60c0fb70fcef52a832c0d495fd73c836a5db1b8e3c8725"}
Oct 30 16:35:40.337291 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.337244    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podStartSLOduration=1.33723122 podStartE2EDuration="1.33723122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:40.335408112 +0000 UTC m=+959.388685722" watchObservedRunningTime="2026-10-30 16:35:40.33723122 +0000 UTC m=+959.390508849"
Oct 30 16:35:40.713634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.713598    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"]
Oct 30 16:35:40.717140 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.717122    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:40.717238 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.717199    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.731805 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.731782    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"]
Oct 30 16:35:40.735680 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.735663    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.742221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.742199    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"]
Oct 30 16:35:40.761122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.761094    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"]
Oct 30 16:35:40.807733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.807704    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.807871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.807757    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.807871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.807856    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/980dadce-85e0-4130-898d-9836658982ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.807933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.807876    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.807933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.807898    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.807933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.807913    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.808030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.807937    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trhdr\" (UniqueName: \"kubernetes.io/projected/980dadce-85e0-4130-898d-9836658982ea-kube-api-access-trhdr\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.808030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.807970    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.808088 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808024    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.808155 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808143    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/980dadce-85e0-4130-898d-9836658982ea-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.808203 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808192    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.808237 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808210    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.808269 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808239    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/980dadce-85e0-4130-898d-9836658982ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.808302 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808266    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.808302 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808289    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.808426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808366    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.808426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808385    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzw7\" (UniqueName: \"kubernetes.io/projected/6369c3b2-2ff1-454a-ba33-237e8a131bc3-kube-api-access-tvzw7\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.808487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.808450    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.909223 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909194    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/980dadce-85e0-4130-898d-9836658982ea-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.909428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909245    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.909428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909383    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.909428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909417    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/980dadce-85e0-4130-898d-9836658982ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.909564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909443    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.909564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909470    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.909564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909511    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.909564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909541    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzw7\" (UniqueName: \"kubernetes.io/projected/6369c3b2-2ff1-454a-ba33-237e8a131bc3-kube-api-access-tvzw7\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.909764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909588    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.909764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909673    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.909764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909730    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.909874 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909829    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/980dadce-85e0-4130-898d-9836658982ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.909874 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909670    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.909874 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909864    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.910004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909902    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.910004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909927    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.910004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909956    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trhdr\" (UniqueName: \"kubernetes.io/projected/980dadce-85e0-4130-898d-9836658982ea-kube-api-access-trhdr\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.910004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.909982    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.910207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910014    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.910207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910045    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.910207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910138    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.910207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910140    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.910207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910140    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.910487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910222    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.910487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910225    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/980dadce-85e0-4130-898d-9836658982ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.910487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910432    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.910633 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910529    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.910633 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.910583    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.912298 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.912272    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/980dadce-85e0-4130-898d-9836658982ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.912452 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.912432    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.912593 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.912572    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.912818 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.912802    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/980dadce-85e0-4130-898d-9836658982ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.931949 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.931919    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/980dadce-85e0-4130-898d-9836658982ea-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.932676 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.932642    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzw7\" (UniqueName: \"kubernetes.io/projected/6369c3b2-2ff1-454a-ba33-237e8a131bc3-kube-api-access-tvzw7\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.933738 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.933713    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trhdr\" (UniqueName: \"kubernetes.io/projected/980dadce-85e0-4130-898d-9836658982ea-kube-api-access-trhdr\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj\" (UID: \"980dadce-85e0-4130-898d-9836658982ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:40.934895 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.934856    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6369c3b2-2ff1-454a-ba33-237e8a131bc3-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f\" (UID: \"6369c3b2-2ff1-454a-ba33-237e8a131bc3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:40.944230 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:40.944188    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:41.031353 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.031258    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:41.050530 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.050502    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:41.349447 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:35:41.349407    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6369c3b2_2ff1_454a_ba33_237e8a131bc3.slice/crio-9ff1cb5beabf78b59f350dfffe01fd4703eca369652d1d2d04ac0c5fd90f0af4 WatchSource:0}: Error finding container 9ff1cb5beabf78b59f350dfffe01fd4703eca369652d1d2d04ac0c5fd90f0af4: Status 404 returned error can't find the container with id 9ff1cb5beabf78b59f350dfffe01fd4703eca369652d1d2d04ac0c5fd90f0af4
Oct 30 16:35:41.349989 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.349964    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"]
Oct 30 16:35:41.351946 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.351919    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:41.352024 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.351980    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:41.352024 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.352008    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:41.377894 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.377872    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"]
Oct 30 16:35:41.381455 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:35:41.381424    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980dadce_85e0_4130_898d_9836658982ea.slice/crio-6f24b5c35e730c1bb333ea3817987b9322ff08fabd474fd1e7088f458ebb5cbf WatchSource:0}: Error finding container 6f24b5c35e730c1bb333ea3817987b9322ff08fabd474fd1e7088f458ebb5cbf: Status 404 returned error can't find the container with id 6f24b5c35e730c1bb333ea3817987b9322ff08fabd474fd1e7088f458ebb5cbf
Oct 30 16:35:41.383993 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.383962    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:41.384054 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.384038    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:41.384096 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:41.384080    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:42.312221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.312186    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" event={"ID":"6369c3b2-2ff1-454a-ba33-237e8a131bc3","Type":"ContainerStarted","Data":"9526ab1adf5e27e14e7da66307fbac333e16c2cb798d4b302c011633730ecf4f"}
Oct 30 16:35:42.312485 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.312460    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" event={"ID":"6369c3b2-2ff1-454a-ba33-237e8a131bc3","Type":"ContainerStarted","Data":"9ff1cb5beabf78b59f350dfffe01fd4703eca369652d1d2d04ac0c5fd90f0af4"}
Oct 30 16:35:42.314280 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.314261    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" event={"ID":"980dadce-85e0-4130-898d-9836658982ea","Type":"ContainerStarted","Data":"e80e8a87e0fa3b5e23aaeca02f5ce22aaa817b6995ab31d328aec9801de0210b"}
Oct 30 16:35:42.314449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.314431    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" event={"ID":"980dadce-85e0-4130-898d-9836658982ea","Type":"ContainerStarted","Data":"6f24b5c35e730c1bb333ea3817987b9322ff08fabd474fd1e7088f458ebb5cbf"}
Oct 30 16:35:42.396361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.395461    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" podStartSLOduration=2.395447261 podStartE2EDuration="2.395447261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:42.379880456 +0000 UTC m=+961.433158103" watchObservedRunningTime="2026-10-30 16:35:42.395447261 +0000 UTC m=+961.448724870"
Oct 30 16:35:42.432172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.432117    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" podStartSLOduration=2.432102576 podStartE2EDuration="2.432102576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:42.429744991 +0000 UTC m=+961.483022602" watchObservedRunningTime="2026-10-30 16:35:42.432102576 +0000 UTC m=+961.485380187"
Oct 30 16:35:42.638447 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.636103    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"]
Oct 30 16:35:42.641194 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.641170    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.672752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.672721    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b8ab9f\"/\"default-dockercfg-t9ckg\""
Oct 30 16:35:42.703933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.691625    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b8ab9f\"/\"kube-root-ca.crt\""
Oct 30 16:35:42.703933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.692322    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b8ab9f\"/\"openshift-service-ca.crt\""
Oct 30 16:35:42.703933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.692524    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b8ab9f\"/\"distinct-w4-b8ab9f-kserve-self-signed-certs\""
Oct 30 16:35:42.703933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.703768    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:42.705039 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.705009    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"]
Oct 30 16:35:42.737257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.737227    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tmp-dir\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.737490 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.737473    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvckj\" (UniqueName: \"kubernetes.io/projected/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-kube-api-access-pvckj\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.737596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.737585    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-model-cache\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.737747 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.737724    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-home\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.737787 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.737763    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-dshm\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.737820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.737807    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tls-certs\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.840560 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.840393    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tmp-dir\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.840560 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.840498    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvckj\" (UniqueName: \"kubernetes.io/projected/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-kube-api-access-pvckj\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.840560 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.840538    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-model-cache\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.840883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.840586    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-home\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.840883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.840612    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-dshm\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.840883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.840649    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tls-certs\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.852361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.849402    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-model-cache\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.852361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.849682    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tmp-dir\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.852361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.850246    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-home\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.878362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.877043    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:42.904418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.888682    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-dshm\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.907376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.906587    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvckj\" (UniqueName: \"kubernetes.io/projected/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-kube-api-access-pvckj\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:42.931396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:42.929388    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tls-certs\") pod \"distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:43.015122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:43.015087    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:43.031556 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:43.031534    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:43.033014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:43.032987    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 16:35:43.033119 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:43.033037    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" podUID="6369c3b2-2ff1-454a-ba33-237e8a131bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 16:35:43.068365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:43.067676    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:43.081366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:43.080663    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:35:43.081366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:43.080718    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" podUID="980dadce-85e0-4130-898d-9836658982ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 16:35:43.390665 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:43.389534    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"]
Oct 30 16:35:43.399672 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:35:43.399429    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ce15dbf_0e81_4cb3_9121_84fc4cdf4378.slice/crio-fed22a6fd0de23c7a0e7c814d732b846832d9623fa74d8598f1f748bc0db5ef0 WatchSource:0}: Error finding container fed22a6fd0de23c7a0e7c814d732b846832d9623fa74d8598f1f748bc0db5ef0: Status 404 returned error can't find the container with id fed22a6fd0de23c7a0e7c814d732b846832d9623fa74d8598f1f748bc0db5ef0
Oct 30 16:35:44.032266 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:44.032233    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 16:35:44.032423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:44.032283    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" podUID="6369c3b2-2ff1-454a-ba33-237e8a131bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 16:35:44.067543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:44.067432    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:35:44.067543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:44.067487    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" podUID="980dadce-85e0-4130-898d-9836658982ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 16:35:44.328982 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:44.328894    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" event={"ID":"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378","Type":"ContainerStarted","Data":"3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523"}
Oct 30 16:35:44.328982 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:44.328945    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" event={"ID":"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378","Type":"ContainerStarted","Data":"fed22a6fd0de23c7a0e7c814d732b846832d9623fa74d8598f1f748bc0db5ef0"}
Oct 30 16:35:44.395365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:44.394787    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podStartSLOduration=2.394766141 podStartE2EDuration="2.394766141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:44.393583478 +0000 UTC m=+963.446861088" watchObservedRunningTime="2026-10-30 16:35:44.394766141 +0000 UTC m=+963.448043751"
Oct 30 16:35:44.802648 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:44.802615    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:45.015927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:45.015891    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:45.032558 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:45.032527    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 16:35:45.032697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:45.032588    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" podUID="6369c3b2-2ff1-454a-ba33-237e8a131bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 16:35:45.073420 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:45.064459    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:35:45.073420 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:45.064519    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" podUID="980dadce-85e0-4130-898d-9836658982ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 16:35:46.031980 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:46.031938    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 16:35:46.032498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:46.031997    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" podUID="6369c3b2-2ff1-454a-ba33-237e8a131bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 16:35:46.061146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:46.060542    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:35:46.061146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:46.060595    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" podUID="980dadce-85e0-4130-898d-9836658982ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 16:35:46.893364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:46.888994    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:47.032334 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:47.032288    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 16:35:47.032761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:47.032376    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" podUID="6369c3b2-2ff1-454a-ba33-237e8a131bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 16:35:47.092832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:47.092794    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:35:47.093030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:47.092853    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" podUID="980dadce-85e0-4130-898d-9836658982ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 16:35:48.031632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.031594    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 16:35:48.031886 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.031652    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" podUID="6369c3b2-2ff1-454a-ba33-237e8a131bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 16:35:48.051037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.051001    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:35:48.051494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.051043    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" podUID="980dadce-85e0-4130-898d-9836658982ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 16:35:48.531911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.531871    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"]
Oct 30 16:35:48.536228 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.536204    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565353    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565426    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhlsj\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-kube-api-access-lhlsj\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565459    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565501    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565546    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565674    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36089829-4672-4052-9efa-f09ab6c5be2e-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565757    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565814    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.566037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.565861    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36089829-4672-4052-9efa-f09ab6c5be2e-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.573379 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.569992    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"]
Oct 30 16:35:48.666549 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666509    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36089829-4672-4052-9efa-f09ab6c5be2e-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.666745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666569    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.666745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666608    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.666745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666634    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36089829-4672-4052-9efa-f09ab6c5be2e-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.666745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666655    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.666745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666677    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhlsj\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-kube-api-access-lhlsj\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.667043 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666874    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.667043 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666939    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.667043 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.666986    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.667214 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.667050    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.667309 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.667269    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.667405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.667336    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.667471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.667440    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.667671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.667651    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36089829-4672-4052-9efa-f09ab6c5be2e-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.669143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.669119    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.669552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.669532    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36089829-4672-4052-9efa-f09ab6c5be2e-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.689747 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.689714    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.690265 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.690239    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhlsj\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-kube-api-access-lhlsj\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.853779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.853693    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:48.883255 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:48.883214    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:49.051173 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.051133    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:35:49.051725 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.051193    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj" podUID="980dadce-85e0-4130-898d-9836658982ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 16:35:49.204445 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:35:49.204397    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36089829_4672_4052_9efa_f09ab6c5be2e.slice/crio-542f708e0980573e364a29b364403a56e32c40c8bd75ac140769d5ade97fe352 WatchSource:0}: Error finding container 542f708e0980573e364a29b364403a56e32c40c8bd75ac140769d5ade97fe352: Status 404 returned error can't find the container with id 542f708e0980573e364a29b364403a56e32c40c8bd75ac140769d5ade97fe352
Oct 30 16:35:49.205465 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.205433    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"]
Oct 30 16:35:49.208120 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.208082    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:49.208220 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.208164    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:49.208220 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.208206    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:35:49.397796 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.397748    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" event={"ID":"36089829-4672-4052-9efa-f09ab6c5be2e","Type":"ContainerStarted","Data":"6f05047d942a3b06c56c4a403cba5698d05a7bcdb3b1d2aba8215dc263b4f14a"}
Oct 30 16:35:49.398097 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.398058    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" event={"ID":"36089829-4672-4052-9efa-f09ab6c5be2e","Type":"ContainerStarted","Data":"542f708e0980573e364a29b364403a56e32c40c8bd75ac140769d5ade97fe352"}
Oct 30 16:35:49.457774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.457619    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" podStartSLOduration=1.457571677 podStartE2EDuration="1.457571677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:49.443682529 +0000 UTC m=+968.496960149" watchObservedRunningTime="2026-10-30 16:35:49.457571677 +0000 UTC m=+968.510849287"
Oct 30 16:35:49.717207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.717123    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:49.736631 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.736603    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:49.853879 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:49.853774    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:50.036535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.036433    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:35:50.036535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.036496    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f" podUID="6369c3b2-2ff1-454a-ba33-237e8a131bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:35:50.095032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.095004    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:50.096197 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.096127    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:50.096777 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.096758    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f"
Oct 30 16:35:50.101287 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.101265    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:50.101988 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.101970    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:50.102824 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.102806    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj"
Oct 30 16:35:50.306924 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:35:50.306849    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:35:50.415560 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.415530    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:35:50.765362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.761449    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:50.867553 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.867515    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 16:35:50.867770 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:50.867570    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 16:35:51.859360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:51.856755    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 16:35:51.859360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:51.856836    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 16:35:52.560849 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:52.560816    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:52.861844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:52.861755    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 16:35:52.862539 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:52.862500    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 16:35:53.015768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:53.015732    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:53.027860 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:53.027837    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:53.468362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:53.462561    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:35:53.859418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:53.856733    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 16:35:53.859418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:53.856810    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 16:35:54.740484 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:54.740451    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:54.865364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:54.856694    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 16:35:54.865364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:54.856767    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 16:35:55.240768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.240738    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"]
Oct 30 16:35:55.265365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.259851    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.274403 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.274350    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"]
Oct 30 16:35:55.278494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.278470    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"distinct-2-w6-063dcc-kserve-self-signed-certs\""
Oct 30 16:35:55.342357 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.342315    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:55.429184 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.429148    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69393570-3f04-4e1b-be5b-214719fc9189-tls-certs\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.429378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.429206    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x8fg\" (UniqueName: \"kubernetes.io/projected/69393570-3f04-4e1b-be5b-214719fc9189-kube-api-access-4x8fg\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.429378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.429322    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-tmp-dir\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.429488 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.429460    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-model-cache\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.429644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.429616    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-dshm\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.429739 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.429724    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-home\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.531357 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.531202    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-dshm\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.531547 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.531405    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-home\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.531547 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.531469    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69393570-3f04-4e1b-be5b-214719fc9189-tls-certs\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.531547 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.531502    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x8fg\" (UniqueName: \"kubernetes.io/projected/69393570-3f04-4e1b-be5b-214719fc9189-kube-api-access-4x8fg\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.531702 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.531575    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-tmp-dir\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.531702 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.531667    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-model-cache\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.531800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.531780    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-home\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.531983 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.531956    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-tmp-dir\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.532105 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.532075    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-model-cache\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.533829 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.533809    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-dshm\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.534283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.534264    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69393570-3f04-4e1b-be5b-214719fc9189-tls-certs\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.556075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.556051    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x8fg\" (UniqueName: \"kubernetes.io/projected/69393570-3f04-4e1b-be5b-214719fc9189-kube-api-access-4x8fg\") pod \"distinct-2-w6-063dcc-kserve-84868dd955-7sfbd\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") " pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.587682 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.587620    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:55.854899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.854823    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 16:35:55.854899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.854876    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 16:35:55.896557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:55.896521    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"]
Oct 30 16:35:55.897681 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:35:55.897510    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69393570_3f04_4e1b_be5b_214719fc9189.slice/crio-fe7faabbe581049d195c6745cf0bf9e83770354d82c556eb6d5ebce4779a76eb WatchSource:0}: Error finding container fe7faabbe581049d195c6745cf0bf9e83770354d82c556eb6d5ebce4779a76eb: Status 404 returned error can't find the container with id fe7faabbe581049d195c6745cf0bf9e83770354d82c556eb6d5ebce4779a76eb
Oct 30 16:35:56.457371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:56.456614    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" event={"ID":"69393570-3f04-4e1b-be5b-214719fc9189","Type":"ContainerStarted","Data":"be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe"}
Oct 30 16:35:56.457371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:56.456664    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" event={"ID":"69393570-3f04-4e1b-be5b-214719fc9189","Type":"ContainerStarted","Data":"fe7faabbe581049d195c6745cf0bf9e83770354d82c556eb6d5ebce4779a76eb"}
Oct 30 16:35:56.499772 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:56.499724    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podStartSLOduration=1.499710243 podStartE2EDuration="1.499710243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:56.498378213 +0000 UTC m=+975.551655823" watchObservedRunningTime="2026-10-30 16:35:56.499710243 +0000 UTC m=+975.552987891"
Oct 30 16:35:56.588023 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:56.587991    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:35:56.695885 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:56.695855    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:35:56.859829 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:56.859748    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:56.860216 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:56.860025    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:56.860699 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:56.860679    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:35:58.550443 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:35:58.550409    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:00.246322 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:00.246277    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:01.897552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:01.897521    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:03.853460 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:03.853425    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:05.555771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:05.555738    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:05.588673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:05.588645    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:36:05.603520 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:05.603491    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:36:06.529108 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:06.529082    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:36:07.436831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:07.436701    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:09.103824 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.103754    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:09.486652 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.486611    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-r5dwp-zkdbz"]
Oct 30 16:36:09.491068 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.491052    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.512187 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.512159    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-r5dwp-zkdbz"]
Oct 30 16:36:09.607313 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.607270    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-service-ca-bundle\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.607500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.607329    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-trusted-ca-bundle\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.607551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.607487    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/602f9d63-2fa1-43b6-bd88-c46900208d85-archives-path\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.607551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.607547    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llbh8\" (UniqueName: \"kubernetes.io/projected/602f9d63-2fa1-43b6-bd88-c46900208d85-kube-api-access-llbh8\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.708507 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.708458    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llbh8\" (UniqueName: \"kubernetes.io/projected/602f9d63-2fa1-43b6-bd88-c46900208d85-kube-api-access-llbh8\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.708711 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.708591    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-service-ca-bundle\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.708711 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.708639    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-trusted-ca-bundle\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.708822 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.708730    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/602f9d63-2fa1-43b6-bd88-c46900208d85-archives-path\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.709110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.709089    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/602f9d63-2fa1-43b6-bd88-c46900208d85-archives-path\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.709291 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.709273    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-service-ca-bundle\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.709402 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.709385    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-trusted-ca-bundle\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.732100 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.732071    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llbh8\" (UniqueName: \"kubernetes.io/projected/602f9d63-2fa1-43b6-bd88-c46900208d85-kube-api-access-llbh8\") pod \"periodic-gathering-r5dwp-zkdbz\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") " pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:09.803984 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:09.803904    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:36:10.105917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:10.105882    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-r5dwp-zkdbz"]
Oct 30 16:36:10.106364 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:36:10.106042    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602f9d63_2fa1_43b6_bd88_c46900208d85.slice/crio-80a024d2dfdadf80ec74a011f716a52e78cccda9347b92372810a92b5da67e0e WatchSource:0}: Error finding container 80a024d2dfdadf80ec74a011f716a52e78cccda9347b92372810a92b5da67e0e: Status 404 returned error can't find the container with id 80a024d2dfdadf80ec74a011f716a52e78cccda9347b92372810a92b5da67e0e
Oct 30 16:36:10.548084 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:10.548048    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz" event={"ID":"602f9d63-2fa1-43b6-bd88-c46900208d85","Type":"ContainerStarted","Data":"943b28d152135f90482447281bb3bd78bfad14949316b98f45afa252336abcb5"}
Oct 30 16:36:10.548292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:10.548098    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz" event={"ID":"602f9d63-2fa1-43b6-bd88-c46900208d85","Type":"ContainerStarted","Data":"80a024d2dfdadf80ec74a011f716a52e78cccda9347b92372810a92b5da67e0e"}
Oct 30 16:36:10.588900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:10.588841    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz" podStartSLOduration=1.588827972 podStartE2EDuration="1.588827972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:36:10.587093214 +0000 UTC m=+989.640370824" watchObservedRunningTime="2026-10-30 16:36:10.588827972 +0000 UTC m=+989.642105581"
Oct 30 16:36:10.839945 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:10.839816    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:12.643726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:12.643674    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:14.391023 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:14.390981    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:15.408006 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:15.407957    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:16.340714 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:16.340678    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:18.118018 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:18.117979    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:18.865952 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:18.865912    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"]
Oct 30 16:36:18.872196 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:18.872169    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:18.906480 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:18.906445    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"]
Oct 30 16:36:19.025554 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025520    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.025709 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025591    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.025709 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025612    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.025785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025702    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.025785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025746    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.025861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025798    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcf2b\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-kube-api-access-gcf2b\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.025861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025851    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.025954 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025871    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.025954 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.025908    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.044776 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.044744    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"]
Oct 30 16:36:19.049119 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.049091    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.081400 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.081371    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"]
Oct 30 16:36:19.127374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127276    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.127817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127385    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.127817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127412    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.127817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127467    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.127817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127497    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.127817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127522    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcf2b\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-kube-api-access-gcf2b\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.127817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127666    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.127817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127699    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.127817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127741    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.128226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127870    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.128226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.127956    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.128226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.128053    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.128226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.128099    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.128226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.128192    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.130177 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.130155    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.130387 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.130363    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.150334 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.150301    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcf2b\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-kube-api-access-gcf2b\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.150523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.150502    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.187286 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.187249    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:19.228790 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.228750    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.228974 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.228902    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.228974 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.228949    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.229107 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.229065    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgzr8\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-kube-api-access-tgzr8\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.229241 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.229225    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.229318 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.229300    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.229433 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.229335    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.229529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.229434    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.229583 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.229557    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.330462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330421    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.330639 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330499    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.330639 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330547    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.330639 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330575    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgzr8\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-kube-api-access-tgzr8\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.330823 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330664    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.330823 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330705    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.330823 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330729    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.330823 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330768    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.331039 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330855    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.331039 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.330866    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.331525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.331156    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.331525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.331285    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.331525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.331292    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.331525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.331479    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.333015 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.332992    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.333278 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.333259    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.354253 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.354226    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.354557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.354539    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgzr8\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-kube-api-access-tgzr8\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.365415 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.365387    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:19.524564 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:36:19.524533    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b6dbca_b179_4b3c_9012_90bb31fc71da.slice/crio-12bc3a326be328d0b6c4ceca178bb9436d45d3204348a83971114e1ca5b5e4f2 WatchSource:0}: Error finding container 12bc3a326be328d0b6c4ceca178bb9436d45d3204348a83971114e1ca5b5e4f2: Status 404 returned error can't find the container with id 12bc3a326be328d0b6c4ceca178bb9436d45d3204348a83971114e1ca5b5e4f2
Oct 30 16:36:19.525674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.525648    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"]
Oct 30 16:36:19.527532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.527502    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:36:19.527619 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.527579    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:36:19.527619 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.527607    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:36:19.608905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.608873    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" event={"ID":"b3b6dbca-b179-4b3c-9012-90bb31fc71da","Type":"ContainerStarted","Data":"a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54"}
Oct 30 16:36:19.609099 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.608938    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" event={"ID":"b3b6dbca-b179-4b3c-9012-90bb31fc71da","Type":"ContainerStarted","Data":"12bc3a326be328d0b6c4ceca178bb9436d45d3204348a83971114e1ca5b5e4f2"}
Oct 30 16:36:19.669520 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.669454    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" podStartSLOduration=1.669420548 podStartE2EDuration="1.669420548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:36:19.664146311 +0000 UTC m=+998.717423920" watchObservedRunningTime="2026-10-30 16:36:19.669420548 +0000 UTC m=+998.722698160"
Oct 30 16:36:19.687554 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:36:19.687528    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8fd1f9_6435_4037_b524_0f3e0cf59a9f.slice/crio-75ec6ca9187d31f6edebcc0934c8b1f5d0f4a6f407ec7380bbceae64ec31e7f4 WatchSource:0}: Error finding container 75ec6ca9187d31f6edebcc0934c8b1f5d0f4a6f407ec7380bbceae64ec31e7f4: Status 404 returned error can't find the container with id 75ec6ca9187d31f6edebcc0934c8b1f5d0f4a6f407ec7380bbceae64ec31e7f4
Oct 30 16:36:19.689603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.689561    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:36:19.689747 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.689728    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:36:19.689844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.689833    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:36:19.691970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.691949    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"]
Oct 30 16:36:19.954512 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:19.954421    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:20.189491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.189451    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:20.190077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.190050    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 16:36:20.190199 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.190106    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 16:36:20.317546 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.317473    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"]
Oct 30 16:36:20.318908 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:36:20.318877    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:36:20.322044 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.321732    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.337786 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.337758    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:36:20.337993 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.337982    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:36:20.387362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.365369    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpbcl\" (UniqueName: \"kubernetes.io/projected/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-kube-api-access-wpbcl\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.387362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.365471    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.387362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.365550    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.406293 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.405525    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"]
Oct 30 16:36:20.498627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.498569    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpbcl\" (UniqueName: \"kubernetes.io/projected/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-kube-api-access-wpbcl\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.499455 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.499411    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.499984 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.499968    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.500975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.500960    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.502834 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.502817    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.522326 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.522302    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpbcl\" (UniqueName: \"kubernetes.io/projected/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-kube-api-access-wpbcl\") pod \"maas-api-revoke-sub-84f07ab6-5zgq5\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.617499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.617396    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" event={"ID":"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f","Type":"ContainerStarted","Data":"7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d"}
Oct 30 16:36:20.617499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.617462    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" event={"ID":"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f","Type":"ContainerStarted","Data":"75ec6ca9187d31f6edebcc0934c8b1f5d0f4a6f407ec7380bbceae64ec31e7f4"}
Oct 30 16:36:20.636155 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.636129    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:20.672376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:20.668498    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" podStartSLOduration=1.668479445 podStartE2EDuration="1.668479445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:36:20.667906162 +0000 UTC m=+999.721183774" watchObservedRunningTime="2026-10-30 16:36:20.668479445 +0000 UTC m=+999.721757056"
Oct 30 16:36:21.080363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.079359    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"]
Oct 30 16:36:21.097837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.097784    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:21.099914 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:36:21.099886    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4edfa72_d616_4ea1_a4aa_f3d0914e8f7b.slice/crio-11618a8e6381f50c21bdc07761e234ea39d9b9471b2ca36e20302394ecd68a9e WatchSource:0}: Error finding container 11618a8e6381f50c21bdc07761e234ea39d9b9471b2ca36e20302394ecd68a9e: Status 404 returned error can't find the container with id 11618a8e6381f50c21bdc07761e234ea39d9b9471b2ca36e20302394ecd68a9e
Oct 30 16:36:21.197377 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.196496    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 16:36:21.197377 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.196568    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 16:36:21.267355 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.267302    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:21.367899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.367813    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:21.368253 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.368230    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 16:36:21.368458 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.368432    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 16:36:21.625991 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.625908    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5" event={"ID":"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b","Type":"ContainerStarted","Data":"11618a8e6381f50c21bdc07761e234ea39d9b9471b2ca36e20302394ecd68a9e"}
Oct 30 16:36:21.886139 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:21.886045    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:22.190363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:22.189763    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 16:36:22.190363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:22.189825    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 16:36:22.387362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:22.387009    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 16:36:22.387362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:22.387068    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 16:36:23.193400 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:23.191661    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 16:36:23.193400 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:23.191706    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 16:36:23.392445 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:23.387084    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 16:36:23.392445 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:23.387142    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 16:36:23.898366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:23.878928    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:24.201422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:24.194494    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 16:36:24.201422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:24.194557    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 16:36:24.367181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:24.366704    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 16:36:24.367181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:24.366769    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 16:36:25.192510 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:25.190685    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 16:36:25.192510 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:25.190746    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 16:36:25.370366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:25.368752    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 16:36:25.370366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:25.368815    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 16:36:25.821615 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:25.817065    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:26.525080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:26.525005    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:26.527237 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:26.527215    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:26.528035 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:26.528014    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:36:26.708608 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:26.708582    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:26.712464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:26.711379    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:26.715449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:26.715327    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:36:26.724735 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:26.724710    5101 generic.go:356] "Generic (PLEG): container finished" podID="c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b" containerID="893d0f924a6da40745be7a14cd67b2fa45aaf55ea3df0fa287b8c2f6d18512d6" exitCode=0
Oct 30 16:36:26.724830 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:26.724792    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5" event={"ID":"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b","Type":"ContainerDied","Data":"893d0f924a6da40745be7a14cd67b2fa45aaf55ea3df0fa287b8c2f6d18512d6"}
Oct 30 16:36:27.552133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:27.552094    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:27.943843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:27.943817    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:28.059439 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.058586    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-openshift-ca\") pod \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") "
Oct 30 16:36:28.059439 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.058717    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-kube-api-access-wpbcl\" (UniqueName: \"kubernetes.io/projected/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-kube-api-access-wpbcl\") pod \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") "
Oct 30 16:36:28.059439 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.058889    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-xks-ca\") pod \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\" (UID: \"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b\") "
Oct 30 16:36:28.080557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.080515    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-openshift-ca" pod "c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b" (UID: "c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:36:28.091854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.091818    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-xks-ca" pod "c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b" (UID: "c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:36:28.093856 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.093823    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-kube-api-access-wpbcl" pod "c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b" (UID: "c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b"). InnerVolumeSpecName "kube-api-access-wpbcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:36:28.206411 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.181814    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpbcl\" (UniqueName: \"kubernetes.io/projected/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-kube-api-access-wpbcl\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:36:28.206411 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.194407    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:36:28.206411 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.194436    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:36:28.740353 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.740322    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"
Oct 30 16:36:28.740772 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.740382    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5" event={"ID":"c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b","Type":"ContainerDied","Data":"11618a8e6381f50c21bdc07761e234ea39d9b9471b2ca36e20302394ecd68a9e"}
Oct 30 16:36:28.740772 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:28.740452    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11618a8e6381f50c21bdc07761e234ea39d9b9471b2ca36e20302394ecd68a9e"
Oct 30 16:36:29.516274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:29.516221    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:31.316357 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:31.316314    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:32.619334 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:32.619282    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:32.783198 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:32.783168    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:33.068426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:33.068392    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:34.905432 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:34.905400    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:36.580236 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:36.580193    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:38.243384 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.240923    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:38.764023 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.763986    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"]
Oct 30 16:36:38.764988 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.764964    5101 cpu_manager.go:414] "containerMap: removing container" podUID="c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b" containerName="revoke-keys"
Oct 30 16:36:38.764988 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.764989    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b" containerName="revoke-keys"
Oct 30 16:36:38.765156 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.765146    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b" containerName="revoke-keys"
Oct 30 16:36:38.770506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.770485    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.787084 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.787056    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"]
Oct 30 16:36:38.796147 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.796109    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"distinct-w5-2e0784-kserve-self-signed-certs\""
Oct 30 16:36:38.796384 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.796372    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"default-dockercfg-qzllj\""
Oct 30 16:36:38.797106 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.797090    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"kube-root-ca.crt\""
Oct 30 16:36:38.797204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.797110    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"openshift-service-ca.crt\""
Oct 30 16:36:38.855634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.855596    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:38.897283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.897242    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tmp-dir\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.897456 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.897395    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-home\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.897582 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.897562    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tls-certs\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.897675 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.897657    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-model-cache\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.897710 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.897689    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-dshm\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.897831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.897811    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjqr2\" (UniqueName: \"kubernetes.io/projected/4e898eb0-fb8e-4109-b1ed-70c86e747f29-kube-api-access-zjqr2\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.999523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.999480    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tmp-dir\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.999523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.999530    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-home\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.999800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.999591    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tls-certs\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.999800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.999619    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-model-cache\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.999800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.999635    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-dshm\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:38.999800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.999690    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjqr2\" (UniqueName: \"kubernetes.io/projected/4e898eb0-fb8e-4109-b1ed-70c86e747f29-kube-api-access-zjqr2\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:39.000023 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.999954    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tmp-dir\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:39.000023 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:38.999997    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-home\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:39.000285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.000257    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-model-cache\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:39.003066 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.003023    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-dshm\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:39.010799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.010768    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tls-certs\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:39.030893 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.030764    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjqr2\" (UniqueName: \"kubernetes.io/projected/4e898eb0-fb8e-4109-b1ed-70c86e747f29-kube-api-access-zjqr2\") pod \"distinct-w5-2e0784-kserve-589968b5d8-pz42x\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") " pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:39.105786 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.105748    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:39.469613 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:36:39.469574    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e898eb0_fb8e_4109_b1ed_70c86e747f29.slice/crio-562643a28ede8aff71b8190316673061c7abcb29d74ded1ec1a4da9360daf458 WatchSource:0}: Error finding container 562643a28ede8aff71b8190316673061c7abcb29d74ded1ec1a4da9360daf458: Status 404 returned error can't find the container with id 562643a28ede8aff71b8190316673061c7abcb29d74ded1ec1a4da9360daf458
Oct 30 16:36:39.471067 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.471043    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"]
Oct 30 16:36:39.811325 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.811235    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" event={"ID":"4e898eb0-fb8e-4109-b1ed-70c86e747f29","Type":"ContainerStarted","Data":"b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7"}
Oct 30 16:36:39.811325 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.811286    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" event={"ID":"4e898eb0-fb8e-4109-b1ed-70c86e747f29","Type":"ContainerStarted","Data":"562643a28ede8aff71b8190316673061c7abcb29d74ded1ec1a4da9360daf458"}
Oct 30 16:36:39.863427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:39.860587    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podStartSLOduration=1.8605683210000001 podStartE2EDuration="1.860568321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:36:39.85828098 +0000 UTC m=+1018.911558590" watchObservedRunningTime="2026-10-30 16:36:39.860568321 +0000 UTC m=+1018.913845932"
Oct 30 16:36:40.106471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:40.106397    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:40.320040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:40.320001    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:42.265472 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:42.263645    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:44.262670 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:44.262621    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:46.736369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:46.728996    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:48.607686 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:48.607649    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:49.107116 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:49.107082    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:49.119193 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:49.119171    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:50.087195 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:50.087165    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:36:50.293133 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:36:50.293097    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:36:50.445989 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:50.445958    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:52.226227 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:52.226193    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:54.124448 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:54.124366    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:55.753225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:55.753179    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:57.621907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:57.621871    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:36:59.479606 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:36:59.479535    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:00.142215 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:00.142183    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:01.825415 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:01.825323    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:02.261062 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:02.261027    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:03.552016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.551982    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"]
Oct 30 16:37:03.561807 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.561779    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.575627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.575602    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"]
Oct 30 16:37:03.661586 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.661553    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:03.739464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.739418    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.739768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.739510    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.739768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.739550    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.739768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.739659    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af01b9f-4689-4c66-9965-c756e8dc00b8-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.739937 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.739819    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.739977 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.739928    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.739977 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.739964    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.740106 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.740079    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.740311 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.740288    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kpd6\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-kube-api-access-2kpd6\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.841779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.841702    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.841779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.841740    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.841779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.841757    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af01b9f-4689-4c66-9965-c756e8dc00b8-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.841787    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.841827    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.841842    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842210 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.842070    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842210 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.842125    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842210 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.842170    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.842280    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.842387    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpd6\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-kube-api-access-2kpd6\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.842414    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842709 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.842687    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.842822 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.842688    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af01b9f-4689-4c66-9965-c756e8dc00b8-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.844260 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.844235    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.844663 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.844644    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.865320 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.865300    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.865470 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.865445    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kpd6\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-kube-api-access-2kpd6\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:03.878441 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:03.878422    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:04.095729 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.095650    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"]
Oct 30 16:37:04.099415 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.099369    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.124033 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.121505    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"]
Oct 30 16:37:04.127112 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.125751    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.133871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.133837    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"]
Oct 30 16:37:04.151402 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.151369    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"]
Oct 30 16:37:04.208156 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:04.208127    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af01b9f_4689_4c66_9965_c756e8dc00b8.slice/crio-ed7e4d2510c8a477144c0be1254b07ba0174d27fb4904d22cdeeb469cc8cb73e WatchSource:0}: Error finding container ed7e4d2510c8a477144c0be1254b07ba0174d27fb4904d22cdeeb469cc8cb73e: Status 404 returned error can't find the container with id ed7e4d2510c8a477144c0be1254b07ba0174d27fb4904d22cdeeb469cc8cb73e
Oct 30 16:37:04.209432 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.209405    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"]
Oct 30 16:37:04.210911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.210878    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.210999 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.210949    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.211049 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.211005    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.240508 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.240478    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" event={"ID":"7af01b9f-4689-4c66-9965-c756e8dc00b8","Type":"ContainerStarted","Data":"ed7e4d2510c8a477144c0be1254b07ba0174d27fb4904d22cdeeb469cc8cb73e"}
Oct 30 16:37:04.250579 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.250551    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"]
Oct 30 16:37:04.254169 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.254138    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af98f09a-061a-4c99-b351-30d4c047ea5e-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.254369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.254175    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c77rj\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-kube-api-access-c77rj\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.254369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.254201    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.254602 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.254580    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.254699 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.254639    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.254804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.254780    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.255050 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.254970    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e727bca-9076-45eb-85d1-578c713eee37-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.255182 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.255164    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.255261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.255197    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.255261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.255227    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.255417 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.255259    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.255417 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.255287    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.255531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.255512    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.255660 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.255588    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.255779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.255758    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.256267 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.256246    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e727bca-9076-45eb-85d1-578c713eee37-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.256391 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.256298    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.256464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.256395    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.256464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.256420    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r5td\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-kube-api-access-7r5td\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.281505 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.281478    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"]
Oct 30 16:37:04.357467 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357379    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.357467 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357425    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e727bca-9076-45eb-85d1-578c713eee37-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.357691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357469    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.357691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357565    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70aff9e-427f-4343-b246-a08e911519d4-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.357691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357617    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.357691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357655    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.357691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357684    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.357945 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357711    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.357945 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357872    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.358058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.357963    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358167    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358232    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358273    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358313    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358364    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e727bca-9076-45eb-85d1-578c713eee37-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358394    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70aff9e-427f-4343-b246-a08e911519d4-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358429    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358437    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358173    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e727bca-9076-45eb-85d1-578c713eee37-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358470    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358517    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.358887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358696    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.358929    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359142    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359169    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r5td\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-kube-api-access-7r5td\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359197    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359236    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af98f09a-061a-4c99-b351-30d4c047ea5e-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359267    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c77rj\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-kube-api-access-c77rj\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359292    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxp75\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-kube-api-access-kxp75\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359332    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359394    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359421    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.359609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359451    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.360165 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359781    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.360165 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.359995    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.360508 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.360476    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.361171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.360874    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af98f09a-061a-4c99-b351-30d4c047ea5e-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.361171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.361131    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.361355 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.361195    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.362197 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.362175    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e727bca-9076-45eb-85d1-578c713eee37-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.362568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.362552    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.383842 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.383816    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.384832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.384811    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.385142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.385123    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c77rj\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-kube-api-access-c77rj\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.386903 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.386885    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r5td\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-kube-api-access-7r5td\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.413981 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.413962    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:04.441731 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.441703    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.460734    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.460786    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70aff9e-427f-4343-b246-a08e911519d4-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.460904    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.460957    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.460991    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.461029    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70aff9e-427f-4343-b246-a08e911519d4-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.461090    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.461130    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxp75\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-kube-api-access-kxp75\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.461190    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.461932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.461652    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.471506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.463354    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70aff9e-427f-4343-b246-a08e911519d4-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.471506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.463615    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.471506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.463846    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.471506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.464277    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.471506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.469006    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.474251 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.474235    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70aff9e-427f-4343-b246-a08e911519d4-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.489320 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.489264    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.498379 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.498196    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxp75\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-kube-api-access-kxp75\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.578962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.578715    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:04.767907 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:04.767861    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf98f09a_061a_4c99_b351_30d4c047ea5e.slice/crio-15409ee841824ead5af57b2132b6fd99e9815c9ae3567e1d71af6cf267e966c6 WatchSource:0}: Error finding container 15409ee841824ead5af57b2132b6fd99e9815c9ae3567e1d71af6cf267e966c6: Status 404 returned error can't find the container with id 15409ee841824ead5af57b2132b6fd99e9815c9ae3567e1d71af6cf267e966c6
Oct 30 16:37:04.769799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.769767    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"]
Oct 30 16:37:04.771040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.771007    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.771149 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.771087    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.771149 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.771130    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.790850 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.790745    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"]
Oct 30 16:37:04.792596 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:04.792566    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e727bca_9076_45eb_85d1_578c713eee37.slice/crio-4fa2446cebf393a3e77ab00deace213424a44e044ee1dfbf21fb5281e5695f8a WatchSource:0}: Error finding container 4fa2446cebf393a3e77ab00deace213424a44e044ee1dfbf21fb5281e5695f8a: Status 404 returned error can't find the container with id 4fa2446cebf393a3e77ab00deace213424a44e044ee1dfbf21fb5281e5695f8a
Oct 30 16:37:04.795128 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.795098    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.795214 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.795187    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.795267 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.795214    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.922936 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:04.922889    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70aff9e_427f_4343_b246_a08e911519d4.slice/crio-fa0167d0e5e3b5d39e694df3e5e7fd4ef38345cfc8ca2beec29774e14609969a WatchSource:0}: Error finding container fa0167d0e5e3b5d39e694df3e5e7fd4ef38345cfc8ca2beec29774e14609969a: Status 404 returned error can't find the container with id fa0167d0e5e3b5d39e694df3e5e7fd4ef38345cfc8ca2beec29774e14609969a
Oct 30 16:37:04.923856 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.923391    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"]
Oct 30 16:37:04.931829 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.926353    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.931829 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.926424    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:04.931829 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:04.926466    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:05.291527 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.291314    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" event={"ID":"3e727bca-9076-45eb-85d1-578c713eee37","Type":"ContainerStarted","Data":"71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2"}
Oct 30 16:37:05.291527 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.291395    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" event={"ID":"3e727bca-9076-45eb-85d1-578c713eee37","Type":"ContainerStarted","Data":"4fa2446cebf393a3e77ab00deace213424a44e044ee1dfbf21fb5281e5695f8a"}
Oct 30 16:37:05.294507 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.294471    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" event={"ID":"7af01b9f-4689-4c66-9965-c756e8dc00b8","Type":"ContainerStarted","Data":"0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69"}
Oct 30 16:37:05.305132 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.305100    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" event={"ID":"f70aff9e-427f-4343-b246-a08e911519d4","Type":"ContainerStarted","Data":"ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222"}
Oct 30 16:37:05.305325 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.305310    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" event={"ID":"f70aff9e-427f-4343-b246-a08e911519d4","Type":"ContainerStarted","Data":"fa0167d0e5e3b5d39e694df3e5e7fd4ef38345cfc8ca2beec29774e14609969a"}
Oct 30 16:37:05.307390 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.307366    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" event={"ID":"af98f09a-061a-4c99-b351-30d4c047ea5e","Type":"ContainerStarted","Data":"cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a"}
Oct 30 16:37:05.307485 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.307408    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" event={"ID":"af98f09a-061a-4c99-b351-30d4c047ea5e","Type":"ContainerStarted","Data":"15409ee841824ead5af57b2132b6fd99e9815c9ae3567e1d71af6cf267e966c6"}
Oct 30 16:37:05.340410 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.339987    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podStartSLOduration=1.339967455 podStartE2EDuration="1.339967455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:05.33875024 +0000 UTC m=+1044.392027851" watchObservedRunningTime="2026-10-30 16:37:05.339967455 +0000 UTC m=+1044.393245065"
Oct 30 16:37:05.409318 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.408859    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podStartSLOduration=1.408834486 podStartE2EDuration="1.408834486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:05.407779415 +0000 UTC m=+1044.461057037" watchObservedRunningTime="2026-10-30 16:37:05.408834486 +0000 UTC m=+1044.462112097"
Oct 30 16:37:05.420033 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.420005    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:05.420412 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.420285    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 16:37:05.420588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.420558    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 16:37:05.449362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.447266    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:05.470363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.464838    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 16:37:05.470363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.464910    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 16:37:05.516818 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.513889    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podStartSLOduration=2.513868273 podStartE2EDuration="2.513868273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:05.46588103 +0000 UTC m=+1044.519158642" watchObservedRunningTime="2026-10-30 16:37:05.513868273 +0000 UTC m=+1044.567145885"
Oct 30 16:37:05.516818 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.514061    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podStartSLOduration=1.514054839 podStartE2EDuration="1.514054839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:05.513314671 +0000 UTC m=+1044.566592292" watchObservedRunningTime="2026-10-30 16:37:05.514054839 +0000 UTC m=+1044.567332450"
Oct 30 16:37:05.579587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.579493    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:05.831613 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.831540    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:05.896149 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.896119    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:05.908578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.908542    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 16:37:05.908855 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:05.908827    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 16:37:06.441219 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:06.439420    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 16:37:06.441219 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:06.439494    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 16:37:06.443121 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:06.443088    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 16:37:06.443390 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:06.443358    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 16:37:06.598368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:06.590624    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 16:37:06.598368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:06.590688    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 16:37:06.882377 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:06.881104    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 16:37:06.882377 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:06.881172    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 16:37:07.254620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.241971    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:07.425380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.423297    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:07.426097 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.426006    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 16:37:07.426097 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.426050    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 16:37:07.466022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.465894    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 16:37:07.466022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.465960    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 16:37:07.543423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.542249    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:07.591399 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.591268    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 16:37:07.591399 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.591332    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 16:37:07.882419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.881817    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 16:37:07.882419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:07.881893    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 16:37:08.133412 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.124772    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:08.246683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.244447    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:08.246683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.245205    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:37:08.449366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.449075    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 16:37:08.449366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.449137    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 16:37:08.450895 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.450816    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 16:37:08.451140 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.451104    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 16:37:08.585000 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.584958    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 16:37:08.585260 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.585229    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 16:37:08.903368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.900434    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 16:37:08.903368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:08.900491    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 16:37:09.251422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.248475    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:09.418365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.417722    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 16:37:09.418365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.417794    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 16:37:09.443374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.442980    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 16:37:09.443374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.443054    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 16:37:09.502419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.497415    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:09.540364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.525452    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 16:37:09.791958 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.791460    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 16:37:09.937751 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.937076    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 16:37:09.968292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:09.968250    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 16:37:10.005298 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.005255    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 16:37:10.080549 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.079434    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:10.115769 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.115441    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:10.255139 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.254922    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:10.461359 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.452765    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 16:37:10.461359 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.452828    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 16:37:10.464401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.461931    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:37:10.464401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.462043    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 16:37:10.464401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.462066    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 16:37:10.518615 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.504119    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 16:37:10.518615 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.504525    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:37:10.548364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.547450    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 16:37:10.548364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.547799    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:37:10.599774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.599738    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 16:37:10.624079 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.624042    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 16:37:10.868425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.844043    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:10.916520 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.880847    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 16:37:10.933365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:10.924464    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 16:37:11.097472 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.097431    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:11.254365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.239057    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:11.275362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.263014    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": context deadline exceeded"
Oct 30 16:37:11.366588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.366551    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:37:11.453361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.452417    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 16:37:11.453361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.452474    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 16:37:11.465898 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.465850    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:11.664365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.552421    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 16:37:11.664365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.660208    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:37:11.673016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.552498    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 16:37:11.673016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.664772    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 16:37:11.673016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.588638    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:11.699018 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.697626    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 16:37:11.699018 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.697684    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 16:37:11.702836 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.701582    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:37:11.703358 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.703043    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:37:11.748435 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.748093    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:37:11.901368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.900907    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 16:37:11.901368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.900967    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 16:37:11.969700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:11.931960    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:37:12.110380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.093694    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:37:12.416387 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.415137    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 16:37:12.416387 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.415194    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 16:37:12.448664 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.448533    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 16:37:12.448664 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.448593    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 16:37:12.580160 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.580122    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 16:37:12.580471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.580439    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 16:37:12.884644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.884547    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:12.886157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.886135    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:12.888169 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.888143    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:37:12.992150 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:12.990815    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:13.724752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:13.724720    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:13.727636 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:13.727610    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:13.731302 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:13.731281    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:37:14.034418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:14.028677    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:14.076362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:14.057109    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:14.097419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:14.087153    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:37:14.284147 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:14.284111    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:14.292383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:14.292223    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:14.313367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:14.313207    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:37:15.372374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:15.368984    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:17.108861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:17.108826    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:18.609573 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.609538    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"]
Oct 30 16:37:18.613620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.613596    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.647530 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.647499    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"]
Oct 30 16:37:18.751528 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.751494    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.751715 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.751550    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.751715 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.751684    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smk25\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-kube-api-access-smk25\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.751820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.751760    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.751923 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.751879    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cff232-c732-440a-bdc1-c18faddb48d9-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.751970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.751951    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.752019 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.751978    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.752088 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.752071    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cff232-c732-440a-bdc1-c18faddb48d9-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.752285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.752259    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.804416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.804381    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"]
Oct 30 16:37:18.807663 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.807642    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:18.831394 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.831317    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:18.838831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.838799    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"]
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.854808    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.854857    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.854953    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cff232-c732-440a-bdc1-c18faddb48d9-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.855131    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.855196    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.855243    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.855280    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smk25\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-kube-api-access-smk25\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.855319    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.855370    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cff232-c732-440a-bdc1-c18faddb48d9-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.856516    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.856880    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.857083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.856907    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.858199 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.857231    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.858948 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.858918    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cff232-c732-440a-bdc1-c18faddb48d9-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.860764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.860710    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cff232-c732-440a-bdc1-c18faddb48d9-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.871901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.871875    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.880189 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.880160    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.882122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.882049    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smk25\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-kube-api-access-smk25\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:18.931407 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.931374    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996076    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996203    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996231    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996285    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996389    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996417    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996444    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996474    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:18.996568    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br27x\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-kube-api-access-br27x\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.003992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.003946    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.098799    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br27x\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-kube-api-access-br27x\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.098928    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.099074    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.099105    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.099164    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.099276    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.099307    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.099356    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.099500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.099389    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.101075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.101049    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.102481 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.102459    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.102667 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.102641    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.103032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.102992    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.103032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.103006    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.106384 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.105607    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.106384 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.105778    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.125198 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.125133    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.125852 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.125829    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br27x\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-kube-api-access-br27x\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.217458 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.217421    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"]
Oct 30 16:37:19.221073 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.221053    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.251479 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.251443    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"]
Oct 30 16:37:19.302678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.302636    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.302833 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.302781    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g72n\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-kube-api-access-4g72n\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.302833 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.302817    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.303016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.302987    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.303070 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.303053    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.303169 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.303153    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.303226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.303209    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.303295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.303281    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.303415 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.303393    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.324150 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.324122    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"]
Oct 30 16:37:19.327432 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.327410    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.332703 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:19.332680    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29cff232_c732_440a_bdc1_c18faddb48d9.slice/crio-494f737098bc093f0db5c0d8a699ad9f8b35a4bbc6daf7caeb06e431519a012d WatchSource:0}: Error finding container 494f737098bc093f0db5c0d8a699ad9f8b35a4bbc6daf7caeb06e431519a012d: Status 404 returned error can't find the container with id 494f737098bc093f0db5c0d8a699ad9f8b35a4bbc6daf7caeb06e431519a012d
Oct 30 16:37:19.333989 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.333964    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"]
Oct 30 16:37:19.335998 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.335961    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.336106 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.336044    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.336106 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.336090    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.362175 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.361896    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"]
Oct 30 16:37:19.404554 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.404524    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.404709 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.404572    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.404709 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.404617    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g72n\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-kube-api-access-4g72n\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.404813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.404769    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.404905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.404877    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.404981 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.404963    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.405020 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.404993    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.405057 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405023    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.405091 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405068    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.405122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405096    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.405154 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405122    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.405154 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405144    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.405225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405179    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.405257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405227    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.405257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405247    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.405312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405269    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2klk5\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-kube-api-access-2klk5\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.405312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405285    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.405398 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405330    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.405524 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405504    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.406067 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.405797    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.406067 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.406002    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.406067 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.406033    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.406271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.406181    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.407683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.407663    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.408547 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.408514    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.423261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.423231    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:19.429120 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.429095    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g72n\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-kube-api-access-4g72n\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.429369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.429323    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507454    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507505    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2klk5\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-kube-api-access-2klk5\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507530    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507621    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507654    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507729    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507784    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507861    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.508882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.507893    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.512683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.510999    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.512683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.511670    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.512683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.511853    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.513096 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.513058    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.513911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.513494    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.513911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.513845    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.515956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.515912    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.532991 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.532945    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2klk5\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-kube-api-access-2klk5\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.533163 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.533115    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.534192 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.534005    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:19.561283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.561249    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" event={"ID":"29cff232-c732-440a-bdc1-c18faddb48d9","Type":"ContainerStarted","Data":"befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe"}
Oct 30 16:37:19.561490 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.561310    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" event={"ID":"29cff232-c732-440a-bdc1-c18faddb48d9","Type":"ContainerStarted","Data":"494f737098bc093f0db5c0d8a699ad9f8b35a4bbc6daf7caeb06e431519a012d"}
Oct 30 16:37:19.610238 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.610174    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podStartSLOduration=1.610155211 podStartE2EDuration="1.610155211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:19.606032146 +0000 UTC m=+1058.659309756" watchObservedRunningTime="2026-10-30 16:37:19.610155211 +0000 UTC m=+1058.663432823"
Oct 30 16:37:19.646466 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.645751    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:19.755552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.755277    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"]
Oct 30 16:37:19.771090 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:19.771048    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2637f4a9_81ac_4c7f_beef_446cf3358d7d.slice/crio-fdb39e05f3d66670eeaed9a24ba4db3e088bc84cf45040cce8a7bb873cd34b82 WatchSource:0}: Error finding container fdb39e05f3d66670eeaed9a24ba4db3e088bc84cf45040cce8a7bb873cd34b82: Status 404 returned error can't find the container with id fdb39e05f3d66670eeaed9a24ba4db3e088bc84cf45040cce8a7bb873cd34b82
Oct 30 16:37:19.774058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.773816    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.774058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.773899    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.774058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.773946    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.873241 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:19.873216    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c26e27_640d_4d7b_b99b_f572e6edbc9c.slice/crio-7d5bbff4d3de8f4946d9eefbe00d4eaad4fbf3b185434a9ad87eee5b5825ec5e WatchSource:0}: Error finding container 7d5bbff4d3de8f4946d9eefbe00d4eaad4fbf3b185434a9ad87eee5b5825ec5e: Status 404 returned error can't find the container with id 7d5bbff4d3de8f4946d9eefbe00d4eaad4fbf3b185434a9ad87eee5b5825ec5e
Oct 30 16:37:19.873968 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.873934    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"]
Oct 30 16:37:19.876147 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.876116    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.876220 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.876181    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.876220 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.876210    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.931540 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.931512    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:19.995174 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:19.995137    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d2a6e8_c68b_4be6_8c2b_6a8bcdb90ead.slice/crio-4caf665b1bb522980177fb032141c11aa7cc471ba53f09e7348b8bcdd6e4fd1c WatchSource:0}: Error finding container 4caf665b1bb522980177fb032141c11aa7cc471ba53f09e7348b8bcdd6e4fd1c: Status 404 returned error can't find the container with id 4caf665b1bb522980177fb032141c11aa7cc471ba53f09e7348b8bcdd6e4fd1c
Oct 30 16:37:19.995842 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.995780    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"]
Oct 30 16:37:19.998057 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.998011    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.998230 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.998088    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:19.998230 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:19.998114    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:20.335168 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:37:20.335076    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:37:20.621491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.621400    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" event={"ID":"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead","Type":"ContainerStarted","Data":"19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a"}
Oct 30 16:37:20.621906 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.621734    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" event={"ID":"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead","Type":"ContainerStarted","Data":"4caf665b1bb522980177fb032141c11aa7cc471ba53f09e7348b8bcdd6e4fd1c"}
Oct 30 16:37:20.623740 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.623713    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" event={"ID":"d9c26e27-640d-4d7b-b99b-f572e6edbc9c","Type":"ContainerStarted","Data":"96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a"}
Oct 30 16:37:20.623884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.623753    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" event={"ID":"d9c26e27-640d-4d7b-b99b-f572e6edbc9c","Type":"ContainerStarted","Data":"7d5bbff4d3de8f4946d9eefbe00d4eaad4fbf3b185434a9ad87eee5b5825ec5e"}
Oct 30 16:37:20.626329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.626300    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" event={"ID":"2637f4a9-81ac-4c7f-beef-446cf3358d7d","Type":"ContainerStarted","Data":"55d3840b561e0747a0663c517caf9439e43e5d2db2f6a2abb119904876bc7797"}
Oct 30 16:37:20.626329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.626363    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" event={"ID":"2637f4a9-81ac-4c7f-beef-446cf3358d7d","Type":"ContainerStarted","Data":"fdb39e05f3d66670eeaed9a24ba4db3e088bc84cf45040cce8a7bb873cd34b82"}
Oct 30 16:37:20.650360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.648669    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:20.687364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.686788    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podStartSLOduration=1.686767562 podStartE2EDuration="1.686767562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:20.682023477 +0000 UTC m=+1059.735301086" watchObservedRunningTime="2026-10-30 16:37:20.686767562 +0000 UTC m=+1059.740045173"
Oct 30 16:37:20.739635 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.738502    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podStartSLOduration=1.738472029 podStartE2EDuration="1.738472029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:20.735955413 +0000 UTC m=+1059.789233024" watchObservedRunningTime="2026-10-30 16:37:20.738472029 +0000 UTC m=+1059.791749639"
Oct 30 16:37:20.937583 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.933089    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:20.937583 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.937517    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 16:37:20.937856 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:20.937597    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 16:37:21.427360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.426419    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:21.433574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.433538    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 16:37:21.434011 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.433979    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 16:37:21.547134 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.547102    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:21.547551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.547525    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 16:37:21.547743 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.547719    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 16:37:21.659483 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.659452    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 16:37:21.660049 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.660016    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 16:37:21.931805 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.931768    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 16:37:21.932086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:21.932059    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 16:37:22.176650 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.176598    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.260541 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.260431    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.428368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.424726    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.428368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.424799    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 16:37:22.538416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.537734    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.538416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.537798    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 16:37:22.649365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.648780    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.649365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.648840    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 16:37:22.753366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.752652    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.766364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.765463    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 16:37:22.932854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.932811    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.933777 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.933753    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 16:37:22.934327 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:22.933670    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.183034 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.179462    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.183034 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.181433    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:37:23.204574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.204502    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:23.248377 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.247677    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podStartSLOduration=5.247652257 podStartE2EDuration="5.247652257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:20.790685906 +0000 UTC m=+1059.843963519" watchObservedRunningTime="2026-10-30 16:37:23.247652257 +0000 UTC m=+1062.300929867"
Oct 30 16:37:23.314363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.313794    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.314586 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.314503    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:37:23.460421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.459205    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 16:37:23.460421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.459273    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 16:37:23.539364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.538462    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 16:37:23.539364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.538539    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 16:37:23.965485 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:23.965426    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.004795    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.132265    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.076773    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.006191    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.132470    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.034489    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.132520    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.078263    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": context deadline exceeded"
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.134418    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:37:24.175406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.134465    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:37:24.190837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.183593    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.360361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.360250    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.456819 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.448460    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.456819 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.448518    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 16:37:24.663443 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.645716    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.663443 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.645956    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 16:37:24.816890 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.765091    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.816890 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.765167    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 16:37:24.997864 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.997772    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.998435 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:24.998404    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 16:37:25.355419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.336806    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.356277 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.338503    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.391535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.338658    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.391851 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.338783    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.426364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.363813    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:25.553673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.553635    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.553927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.553904    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 16:37:25.606423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.602169    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.606423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.602225    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 16:37:25.695529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.678630    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.695529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.678700    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 16:37:25.935222 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.934792    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.935222 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:25.934858    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 16:37:26.106416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.080984    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:26.358666 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.357444    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.394364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.393407    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.395172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.395122    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 16:37:26.426991 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.424861    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.426991 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.424921    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 16:37:26.426991 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.425752    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.426991 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.426012    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 16:37:26.541364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.536158    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.541364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.536221    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 16:37:26.670908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.655328    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.670908 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.655445    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 16:37:26.764365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.730360    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.970454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.948079    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:37:26.970454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.951656    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.970454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.951714    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 16:37:26.991394 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:26.990711    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:37:27.011457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.011426    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:37:27.032162 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.031397    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:37:27.205754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.204398    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:37:27.424041 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.424007    5101 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.424313 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.424276    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 16:37:27.535551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.535508    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.535776 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.535574    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 16:37:27.647125 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.647081    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.647333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:27.647154    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 16:37:28.203151 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:28.203113    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:28.206127 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:28.205334    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:28.210901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:28.210835    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:37:28.325123 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:28.325087    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:28.434902 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:28.434870    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:28.436482 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:28.436450    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:28.438830 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:28.438801    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:37:29.044134 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:29.044104    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:29.044907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:29.044887    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:29.046014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:29.045988    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:37:29.134692 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:29.134658    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:29.135042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:29.135015    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:29.136137 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:29.136111    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:37:30.225456 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:30.225421    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:31.966824 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:31.966774    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:32.890557 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:32.890527    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:33.860290 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:33.860246    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:34.272160 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.272121    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"]
Oct 30 16:37:34.277552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.277522    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.315832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.315800    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"]
Oct 30 16:37:34.342187 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342157    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.342378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342218    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0776caf0-db6e-4466-af81-9c6147083465-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.342515 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342488    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssng8\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-kube-api-access-ssng8\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.342579 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342556    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.342650 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342632    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.342718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342692    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.342771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342761    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.342874 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342859    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0776caf0-db6e-4466-af81-9c6147083465-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.342972 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.342957    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444019    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444070    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444117    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0776caf0-db6e-4466-af81-9c6147083465-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444190    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444236    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444274    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0776caf0-db6e-4466-af81-9c6147083465-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444443    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssng8\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-kube-api-access-ssng8\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444472    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444495    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444506    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444552 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444539    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444739    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.444958 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444895    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0776caf0-db6e-4466-af81-9c6147083465-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.445011 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.444985    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.446820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.446793    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.447143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.447125    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0776caf0-db6e-4466-af81-9c6147083465-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.469909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.469885    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.470620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.470600    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssng8\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-kube-api-access-ssng8\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.493455 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.493260    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"]
Oct 30 16:37:34.505432 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.505407    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.518467 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.518436    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"]
Oct 30 16:37:34.520671 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.520643    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"default-dockercfg-69c6c\""
Oct 30 16:37:34.520780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.520749    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"kube-root-ca.crt\""
Oct 30 16:37:34.520862 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.520834    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"distinct-w1-b55521-kserve-self-signed-certs\""
Oct 30 16:37:34.520976 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.520900    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"openshift-service-ca.crt\""
Oct 30 16:37:34.593313 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.593242    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:34.610204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.610171    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:34.648299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.647600    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rmsp\" (UniqueName: \"kubernetes.io/projected/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-kube-api-access-2rmsp\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.648299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.647734    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-dshm\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.648299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.647766    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-model-cache\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.648299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.647857    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tls-certs\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.648299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.647960    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-home\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.648299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.648099    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tmp-dir\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.810932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.810890    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tmp-dir\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.811131 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.811066    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmsp\" (UniqueName: \"kubernetes.io/projected/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-kube-api-access-2rmsp\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.811211 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.811160    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-dshm\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.811211 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.811183    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-model-cache\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.811332 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.811268    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tls-certs\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.811407 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.811382    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-home\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.812862 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.811978    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-home\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.812862 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.812216    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tmp-dir\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.813732 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.813380    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-model-cache\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.825875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.825826    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tls-certs\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.827544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.827519    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-dshm\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.837170 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.837143    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmsp\" (UniqueName: \"kubernetes.io/projected/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-kube-api-access-2rmsp\") pod \"distinct-w1-b55521-kserve-657955df9d-ttbbp\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:34.951674 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:34.951641    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0776caf0_db6e_4466_af81_9c6147083465.slice/crio-45dfb3a4b445fd2dbc9e3e09bfd4cce0a98582e3fe9f9a3b31a0f97175e5cdb6 WatchSource:0}: Error finding container 45dfb3a4b445fd2dbc9e3e09bfd4cce0a98582e3fe9f9a3b31a0f97175e5cdb6: Status 404 returned error can't find the container with id 45dfb3a4b445fd2dbc9e3e09bfd4cce0a98582e3fe9f9a3b31a0f97175e5cdb6
Oct 30 16:37:34.953887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.953866    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"]
Oct 30 16:37:34.954724 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.954695    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:34.954772 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.954758    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:34.954817 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:34.954788    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:35.122726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.122693    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:35.434434 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:35.434402    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ab67649_1d10_49fd_9c99_35c2ab8b5e6d.slice/crio-83f09d56ebb0b8f3996a8ba4741f574f8c4f17627526d850652f943e1b4b9c7a WatchSource:0}: Error finding container 83f09d56ebb0b8f3996a8ba4741f574f8c4f17627526d850652f943e1b4b9c7a: Status 404 returned error can't find the container with id 83f09d56ebb0b8f3996a8ba4741f574f8c4f17627526d850652f943e1b4b9c7a
Oct 30 16:37:35.435875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.435848    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"]
Oct 30 16:37:35.676296 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.676263    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:35.835496 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.835415    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" event={"ID":"0776caf0-db6e-4466-af81-9c6147083465","Type":"ContainerStarted","Data":"4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f"}
Oct 30 16:37:35.835496 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.835477    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" event={"ID":"0776caf0-db6e-4466-af81-9c6147083465","Type":"ContainerStarted","Data":"45dfb3a4b445fd2dbc9e3e09bfd4cce0a98582e3fe9f9a3b31a0f97175e5cdb6"}
Oct 30 16:37:35.836969 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.836946    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" event={"ID":"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d","Type":"ContainerStarted","Data":"e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038"}
Oct 30 16:37:35.837088 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.836974    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" event={"ID":"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d","Type":"ContainerStarted","Data":"83f09d56ebb0b8f3996a8ba4741f574f8c4f17627526d850652f943e1b4b9c7a"}
Oct 30 16:37:35.915119 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.915069    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podStartSLOduration=1.9150537600000002 podStartE2EDuration="1.91505376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:35.912565345 +0000 UTC m=+1074.965842957" watchObservedRunningTime="2026-10-30 16:37:35.91505376 +0000 UTC m=+1074.968331369"
Oct 30 16:37:35.978740 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:35.978690    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podStartSLOduration=1.9786744010000001 podStartE2EDuration="1.978674401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:35.974588742 +0000 UTC m=+1075.027866354" watchObservedRunningTime="2026-10-30 16:37:35.978674401 +0000 UTC m=+1075.031952009"
Oct 30 16:37:36.123559 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:36.123477    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:36.611172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:36.611142    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:36.613120 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:36.613091    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 16:37:36.613254 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:36.613152    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 16:37:37.428244 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:37.428059    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:37.611000 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:37.610958    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 16:37:37.611180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:37.611027    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 16:37:38.610964 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:38.610933    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 16:37:38.611466 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:38.610991    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 16:37:39.286404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:39.285198    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:39.611318 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:39.611229    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 16:37:39.611318 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:39.611300    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 16:37:40.611451 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:40.611415    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 16:37:40.611931 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:40.611489    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 16:37:41.219648 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:41.219609    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:41.620421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:41.610726    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 16:37:41.620421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:41.610791    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 16:37:42.406362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:42.405417    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:42.614368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:42.610631    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 16:37:42.614368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:42.610693    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 16:37:43.209529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:43.209481    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.224471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:43.224425    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.357482 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:43.357431    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.363446 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:43.363407    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.405657 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:43.405611    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.406421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:43.406396    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:37:44.037597 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.037539    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.270377 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.270029    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.270883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.270702    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:37:44.333421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.302447    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 16:37:44.333421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.303072    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:37:44.366696 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.366656    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": context deadline exceeded"
Oct 30 16:37:44.368121 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.368095    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:37:44.430389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.406361    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.507490 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.507437    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:37:44.567365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.546417    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:37:44.738234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.738190    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:44.738530 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.738494    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.799179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.799138    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:44.799519 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:44.799466    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.172365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.148648    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:45.172365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.148712    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.173546 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.173510    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:45.173765 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.173737    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.237900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.237865    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:45.238174 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.238143    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.309589 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.309535    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.322364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.310479    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 16:37:45.394366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.367456    5101 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:45.394366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.367519    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.394366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.367606    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.424480 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.409435    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:45.524521 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.524478    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 16:37:45.534371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.527290    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.756529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.756433    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:45.756790 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.756757    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.850560 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:45.850529    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"]
Oct 30 16:37:46.003570 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.003532    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"]
Oct 30 16:37:46.003893 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.003872    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.055423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.054482    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 16:37:46.056153 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.056130    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qqpz6\""
Oct 30 16:37:46.078448 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.078419    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:46.182613 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.182571    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:46.190635 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.190608    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 16:37:46.190889 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.190873    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 16:37:46.202733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.202695    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:37:46.211015 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.210982    5101 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/health\": context deadline exceeded"
Oct 30 16:37:46.231439 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.231385    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/428a5f77-e21f-4b1e-8a35-ad9c4408026a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.233110 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.233079    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.233398 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.233330    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.233523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.233507    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.233628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.233612    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.233840 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.233823    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvrj8\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-kube-api-access-pvrj8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.234156 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.234055    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.438254 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.365521    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:46.522362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.393161    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.522804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.522776    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/428a5f77-e21f-4b1e-8a35-ad9c4408026a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.523008 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.522987    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.523184 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.523170    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.523296 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.523282    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.523425 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.523409    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.523628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.523612    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvrj8\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-kube-api-access-pvrj8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.534832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.426469    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:46.637144 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.631228    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvrj8\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-kube-api-access-pvrj8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.642002 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.637626    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.650080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.436473    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:46.694803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.660551    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.695036 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.678068    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:46.696612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.678490    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:46.696803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.678572    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:37:46.696987 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.696973    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:37:46.701431 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.701393    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:37:46.725801 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.725173    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:37:46.744261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.742055    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.746666 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.746639    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.748032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.747993    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:37:46.748730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.748677    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:37:46.757988 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.757962    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.759831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.759783    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/428a5f77-e21f-4b1e-8a35-ad9c4408026a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-89mvl\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:46.814032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.813992    5101 generic.go:356] "Generic (PLEG): container finished" podID="602f9d63-2fa1-43b6-bd88-c46900208d85" containerID="943b28d152135f90482447281bb3bd78bfad14949316b98f45afa252336abcb5" exitCode=0
Oct 30 16:37:46.815272 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.815234    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz" event={"ID":"602f9d63-2fa1-43b6-bd88-c46900208d85","Type":"ContainerDied","Data":"943b28d152135f90482447281bb3bd78bfad14949316b98f45afa252336abcb5"}
Oct 30 16:37:46.954726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:46.954617    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:47.135935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:47.135906    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:47.485853 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:37:47.485825    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428a5f77_e21f_4b1e_8a35_ad9c4408026a.slice/crio-73995122f67b4cbcea90c43eb57fec4026a1ce04df69af9cf57ca6db34730a91 WatchSource:0}: Error finding container 73995122f67b4cbcea90c43eb57fec4026a1ce04df69af9cf57ca6db34730a91: Status 404 returned error can't find the container with id 73995122f67b4cbcea90c43eb57fec4026a1ce04df69af9cf57ca6db34730a91
Oct 30 16:37:47.486434 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:47.486408    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"]
Oct 30 16:37:47.488172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:47.488159    5101 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:37:47.823536 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:47.823446    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl" event={"ID":"428a5f77-e21f-4b1e-8a35-ad9c4408026a","Type":"ContainerStarted","Data":"73995122f67b4cbcea90c43eb57fec4026a1ce04df69af9cf57ca6db34730a91"}
Oct 30 16:37:47.998880 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:47.998849    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:37:48.023835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.023806    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/602f9d63-2fa1-43b6-bd88-c46900208d85-kube-api-access-llbh8\" (UniqueName: \"kubernetes.io/projected/602f9d63-2fa1-43b6-bd88-c46900208d85-kube-api-access-llbh8\") pod \"602f9d63-2fa1-43b6-bd88-c46900208d85\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") "
Oct 30 16:37:48.023975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.023847    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-trusted-ca-bundle\") pod \"602f9d63-2fa1-43b6-bd88-c46900208d85\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") "
Oct 30 16:37:48.023975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.023876    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/602f9d63-2fa1-43b6-bd88-c46900208d85-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/602f9d63-2fa1-43b6-bd88-c46900208d85-archives-path\") pod \"602f9d63-2fa1-43b6-bd88-c46900208d85\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") "
Oct 30 16:37:48.023975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.023955    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-service-ca-bundle\") pod \"602f9d63-2fa1-43b6-bd88-c46900208d85\" (UID: \"602f9d63-2fa1-43b6-bd88-c46900208d85\") "
Oct 30 16:37:48.024354 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.024248    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602f9d63-2fa1-43b6-bd88-c46900208d85-archives-path" pod "602f9d63-2fa1-43b6-bd88-c46900208d85" (UID: "602f9d63-2fa1-43b6-bd88-c46900208d85"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:37:48.024460 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.024373    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-service-ca-bundle" pod "602f9d63-2fa1-43b6-bd88-c46900208d85" (UID: "602f9d63-2fa1-43b6-bd88-c46900208d85"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:37:48.024460 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.024435    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-trusted-ca-bundle" pod "602f9d63-2fa1-43b6-bd88-c46900208d85" (UID: "602f9d63-2fa1-43b6-bd88-c46900208d85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:37:48.024655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.024640    5101 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-trusted-ca-bundle\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:37:48.024703 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.024658    5101 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/602f9d63-2fa1-43b6-bd88-c46900208d85-archives-path\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:37:48.024703 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.024667    5101 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602f9d63-2fa1-43b6-bd88-c46900208d85-service-ca-bundle\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:37:48.026044 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.026023    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602f9d63-2fa1-43b6-bd88-c46900208d85-kube-api-access-llbh8" pod "602f9d63-2fa1-43b6-bd88-c46900208d85" (UID: "602f9d63-2fa1-43b6-bd88-c46900208d85"). InnerVolumeSpecName "kube-api-access-llbh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:37:48.126114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.126016    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llbh8\" (UniqueName: \"kubernetes.io/projected/602f9d63-2fa1-43b6-bd88-c46900208d85-kube-api-access-llbh8\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:37:48.621014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.620927    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:48.833197 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.833165    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz" event={"ID":"602f9d63-2fa1-43b6-bd88-c46900208d85","Type":"ContainerDied","Data":"80a024d2dfdadf80ec74a011f716a52e78cccda9347b92372810a92b5da67e0e"}
Oct 30 16:37:48.833197 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.833187    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-r5dwp-zkdbz"
Oct 30 16:37:48.833456 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:48.833218    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80a024d2dfdadf80ec74a011f716a52e78cccda9347b92372810a92b5da67e0e"
Oct 30 16:37:50.082174 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:50.082136    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:50.199543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:50.199511    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:50.199666 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:50.199583    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:37:50.295453 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:37:50.295417    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:37:50.371785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:50.371693    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:50.854814 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:50.854774    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl" event={"ID":"428a5f77-e21f-4b1e-8a35-ad9c4408026a","Type":"ContainerStarted","Data":"a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a"}
Oct 30 16:37:50.855092 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:50.854851    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:50.914305 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:50.914247    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl" podStartSLOduration=3.204309259 podStartE2EDuration="5.914229165s" totalImagesPullingTime="2.709919906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:50.912444697 +0000 UTC m=+1089.965722305" watchObservedRunningTime="2026-10-30 16:37:50.914229165 +0000 UTC m=+1089.967506774"
Oct 30 16:37:51.864443 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:51.864413    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:37:52.071941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:52.071908    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:52.879534 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:52.879496    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:53.958806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:53.958773    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:54.831059 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:54.831029    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:55.134434 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:55.134356    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:55.145468 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:55.145440    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:37:56.033490 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:56.033437    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:57.740526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:57.740492    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:57.944299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:57.944265    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"]
Oct 30 16:37:57.956628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:57.956598    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"]
Oct 30 16:37:58.093920 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:58.093845    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:37:59.890918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:37:59.890874    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:01.145761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:01.145717    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:01.329492 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:01.329437    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:01.374354 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:01.374267    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": context deadline exceeded"
Oct 30 16:38:01.534421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:01.533443    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:01.693365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:01.692878    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 16:38:01.716655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:01.709961    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:38:02.472367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.452870    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/ready\": context deadline exceeded"
Oct 30 16:38:02.472367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.453244    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.472367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.454407    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": context deadline exceeded"
Oct 30 16:38:02.472367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.454848    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:38:02.472367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.454901    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:38:02.472367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.454934    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:38:02.605364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.599445    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.605364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.602601    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:38:02.748592 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.748477    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.763412 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:02.753989    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:38:03.327363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:03.318525    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:03.456368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:03.453114    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:03.456368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:03.453572    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:03.456368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:03.454630    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:03.778579 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:03.778522    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:38:04.048408 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:04.048282    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.077267 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:04.077209    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.367036 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:04.366946    5101 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.205s"
Oct 30 16:38:04.367323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:04.367303    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:38:04.378376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:04.367559    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.512367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:04.487425    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.022979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:04.726447    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/ready\": context deadline exceeded"
Oct 30 16:38:05.031236 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:04.726486    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 16:38:05.051535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:04.813869    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.053867 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:05.053837    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:38:05.054078 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:05.054052    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.081503 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:05.081463    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.420363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:05.397470    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 16:38:06.033509 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.033463    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.086666 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.086627    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.152609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.143862    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.153143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.153108    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:38:06.183499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.180761    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.217181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.199792    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.326496 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.326408    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"]
Oct 30 16:38:06.343367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.327814    5101 cpu_manager.go:414] "containerMap: removing container" podUID="602f9d63-2fa1-43b6-bd88-c46900208d85" containerName="insights-gathering"
Oct 30 16:38:06.343837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.343814    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="602f9d63-2fa1-43b6-bd88-c46900208d85" containerName="insights-gathering"
Oct 30 16:38:06.344253 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.344237    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="602f9d63-2fa1-43b6-bd88-c46900208d85" containerName="insights-gathering"
Oct 30 16:38:06.481373 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.475333    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.570763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.570306    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:38:06.571058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.571029    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:38:06.588917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.588858    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"]
Oct 30 16:38:06.589098 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.589086    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:38:06.589571 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.570452    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.639900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.639870    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:38:06.700055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.700024    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:38:06.702169 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.702149    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:38:06.713614 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713586    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skn5t\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-kube-api-access-skn5t\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.713767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713629    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.713767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713685    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.713767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713711    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.713917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713822    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.713917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713867    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.713917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713899    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.714064 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713965    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.714064 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.713988    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.815980 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.815944    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816005    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816163    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816220    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816298 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816267    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816372    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816412    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816430 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816416    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816584 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816564    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skn5t\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-kube-api-access-skn5t\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.816624 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816611    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.817003 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.816978    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.817468 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.817444    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.817946 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.817917    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.818048 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.818033    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.819515 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.819494    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.820064 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.820046    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.839736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.839668    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.840452 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.840423    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skn5t\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-kube-api-access-skn5t\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:06.884385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.884316    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:06.988018 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:06.987983    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:07.044494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.044391    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:07.196603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.196576    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:07.336629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.336595    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"]
Oct 30 16:38:07.337856 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:38:07.337820    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5eca49e_b247_415e_9f7f_c60a579d3fa5.slice/crio-6fc0f9293e725eceb5e0b2bef50c2718091c1f36dffe29240f8b4b7a7851d8bb WatchSource:0}: Error finding container 6fc0f9293e725eceb5e0b2bef50c2718091c1f36dffe29240f8b4b7a7851d8bb: Status 404 returned error can't find the container with id 6fc0f9293e725eceb5e0b2bef50c2718091c1f36dffe29240f8b4b7a7851d8bb
Oct 30 16:38:07.340676 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.340641    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:38:07.340758 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.340723    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:38:07.340800 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.340763    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:38:07.595333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.595240    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" event={"ID":"f5eca49e-b247-415e-9f7f-c60a579d3fa5","Type":"ContainerStarted","Data":"64bd4e9088efc4893e64558046b4019e79629500bb9a5093dbfbda8317e5c530"}
Oct 30 16:38:07.595333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.595317    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" event={"ID":"f5eca49e-b247-415e-9f7f-c60a579d3fa5","Type":"ContainerStarted","Data":"6fc0f9293e725eceb5e0b2bef50c2718091c1f36dffe29240f8b4b7a7851d8bb"}
Oct 30 16:38:07.643745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.643691    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" podStartSLOduration=3.643668448 podStartE2EDuration="3.643668448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:38:07.638730779 +0000 UTC m=+1106.692008393" watchObservedRunningTime="2026-10-30 16:38:07.643668448 +0000 UTC m=+1106.696946058"
Oct 30 16:38:07.988877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.988843    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:07.993826 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:07.993793    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:08.882491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:08.881448    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:08.989643 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:08.989607    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 16:38:08.989831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:08.989663    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 16:38:09.989250 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:09.989213    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 16:38:09.989649 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:09.989264    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 16:38:10.989243 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:10.989210    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 16:38:10.989461 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:10.989263    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 16:38:11.037374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:11.037327    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:11.988421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:11.988326    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 16:38:11.988616 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:11.988438    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 16:38:12.920181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:12.920137    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"]
Oct 30 16:38:12.969993 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:12.969955    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" containerID="cri-o://be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe" gracePeriod=45
Oct 30 16:38:12.978090 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:12.978041    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" containerID="cri-o://f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740" gracePeriod=45
Oct 30 16:38:12.988718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:12.988697    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 16:38:12.988821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:12.988739    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 16:38:13.082833 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.080717    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:13.267361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.266366    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:13.384567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.382795    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:38:13.489176 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.484894    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:38:13.496324 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.496299    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69393570-3f04-4e1b-be5b-214719fc9189-tls-certs\" (UniqueName: \"kubernetes.io/secret/69393570-3f04-4e1b-be5b-214719fc9189-tls-certs\") pod \"69393570-3f04-4e1b-be5b-214719fc9189\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") "
Oct 30 16:38:13.496502 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.496383    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-dshm\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-dshm\") pod \"69393570-3f04-4e1b-be5b-214719fc9189\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") "
Oct 30 16:38:13.496502 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.496425    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-model-cache\") pod \"69393570-3f04-4e1b-be5b-214719fc9189\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") "
Oct 30 16:38:13.496765 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.496737    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69393570-3f04-4e1b-be5b-214719fc9189-kube-api-access-4x8fg\" (UniqueName: \"kubernetes.io/projected/69393570-3f04-4e1b-be5b-214719fc9189-kube-api-access-4x8fg\") pod \"69393570-3f04-4e1b-be5b-214719fc9189\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") "
Oct 30 16:38:13.496890 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.496855    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-tmp-dir\") pod \"69393570-3f04-4e1b-be5b-214719fc9189\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") "
Oct 30 16:38:13.496956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.496896    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-model-cache" pod "69393570-3f04-4e1b-be5b-214719fc9189" (UID: "69393570-3f04-4e1b-be5b-214719fc9189"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.496956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.496935    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-home\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-home\") pod \"69393570-3f04-4e1b-be5b-214719fc9189\" (UID: \"69393570-3f04-4e1b-be5b-214719fc9189\") "
Oct 30 16:38:13.497332 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.497301    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-home" pod "69393570-3f04-4e1b-be5b-214719fc9189" (UID: "69393570-3f04-4e1b-be5b-214719fc9189"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.497533 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.497509    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-tmp-dir" pod "69393570-3f04-4e1b-be5b-214719fc9189" (UID: "69393570-3f04-4e1b-be5b-214719fc9189"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.497945 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.497921    5101 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-model-cache\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.498034 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.497950    5101 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-tmp-dir\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.498034 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.497962    5101 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-home\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.499075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.499054    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69393570-3f04-4e1b-be5b-214719fc9189-kube-api-access-4x8fg" pod "69393570-3f04-4e1b-be5b-214719fc9189" (UID: "69393570-3f04-4e1b-be5b-214719fc9189"). InnerVolumeSpecName "kube-api-access-4x8fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:13.499951 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.499914    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69393570-3f04-4e1b-be5b-214719fc9189-tls-certs" pod "69393570-3f04-4e1b-be5b-214719fc9189" (UID: "69393570-3f04-4e1b-be5b-214719fc9189"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:13.500201 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.500183    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-dshm" pod "69393570-3f04-4e1b-be5b-214719fc9189" (UID: "69393570-3f04-4e1b-be5b-214719fc9189"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.598688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.598651    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-model-cache\") pod \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") "
Oct 30 16:38:13.598848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.598722    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tmp-dir\") pod \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") "
Oct 30 16:38:13.598848 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.598832    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tls-certs\") pod \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") "
Oct 30 16:38:13.598990 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.598928    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-kube-api-access-k6ck4\" (UniqueName: \"kubernetes.io/projected/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-kube-api-access-k6ck4\") pod \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") "
Oct 30 16:38:13.598990 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.598954    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-home\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-home\") pod \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") "
Oct 30 16:38:13.598990 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.598966    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-model-cache" pod "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" (UID: "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.599142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.599064    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-dshm\") pod \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\" (UID: \"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5\") "
Oct 30 16:38:13.599142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.599095    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tmp-dir" pod "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" (UID: "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.600146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.600098    5101 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-model-cache\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.600146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.600125    5101 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tmp-dir\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.600146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.600138    5101 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69393570-3f04-4e1b-be5b-214719fc9189-tls-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.600146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.600151    5101 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69393570-3f04-4e1b-be5b-214719fc9189-dshm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.600446 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.600163    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x8fg\" (UniqueName: \"kubernetes.io/projected/69393570-3f04-4e1b-be5b-214719fc9189-kube-api-access-4x8fg\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.600577 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.600552    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-home" pod "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" (UID: "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.601828 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.601802    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tls-certs" pod "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" (UID: "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:13.601941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.601854    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-kube-api-access-k6ck4" pod "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" (UID: "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5"). InnerVolumeSpecName "kube-api-access-k6ck4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:13.603128 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.603062    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-dshm" pod "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" (UID: "2fc7c872-ab93-48ad-ad9a-bbdef04b79d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.669098 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.669055    5101 generic.go:356] "Generic (PLEG): container finished" podID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerID="f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740" exitCode=0
Oct 30 16:38:13.669307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.669108    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"
Oct 30 16:38:13.669307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.669147    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" event={"ID":"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5","Type":"ContainerDied","Data":"f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740"}
Oct 30 16:38:13.669307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.669203    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" event={"ID":"2fc7c872-ab93-48ad-ad9a-bbdef04b79d5","Type":"ContainerDied","Data":"91278a8911ba1f00b92ea48ddc33dbe1445aa24d48def37dcf1fbd742c8025fe"}
Oct 30 16:38:13.669307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.669226    5101 scope.go:122] "RemoveContainer" containerID="f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740"
Oct 30 16:38:13.671780 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.671754    5101 generic.go:356] "Generic (PLEG): container finished" podID="69393570-3f04-4e1b-be5b-214719fc9189" containerID="be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe" exitCode=0
Oct 30 16:38:13.671889 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.671875    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" event={"ID":"69393570-3f04-4e1b-be5b-214719fc9189","Type":"ContainerDied","Data":"be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe"}
Oct 30 16:38:13.671959 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.671910    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" event={"ID":"69393570-3f04-4e1b-be5b-214719fc9189","Type":"ContainerDied","Data":"fe7faabbe581049d195c6745cf0bf9e83770354d82c556eb6d5ebce4779a76eb"}
Oct 30 16:38:13.672017 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.671975    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"
Oct 30 16:38:13.682891 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.682867    5101 scope.go:122] "RemoveContainer" containerID="f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740"
Oct 30 16:38:13.683208 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:13.683178    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740\": container with ID starting with f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740 not found: ID does not exist" containerID="f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740"
Oct 30 16:38:13.683300 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.683219    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740"} err="failed to get container status \"f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740\": rpc error: code = NotFound desc = could not find container \"f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740\": container with ID starting with f35f225ca7f5f107461c147420f41541e037bc5d5e5d56a32e9af178f9e90740 not found: ID does not exist"
Oct 30 16:38:13.683300 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.683242    5101 scope.go:122] "RemoveContainer" containerID="be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe"
Oct 30 16:38:13.693933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.693909    5101 scope.go:122] "RemoveContainer" containerID="be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe"
Oct 30 16:38:13.694241 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:13.694221    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe\": container with ID starting with be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe not found: ID does not exist" containerID="be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe"
Oct 30 16:38:13.694295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.694249    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe"} err="failed to get container status \"be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe\": rpc error: code = NotFound desc = could not find container \"be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe\": container with ID starting with be7ca1752b8413e745714bc5d7c79ee4728bf6096edf62682a3eebdead7ea0fe not found: ID does not exist"
Oct 30 16:38:13.702183 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.702162    5101 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-tls-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.702266 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.702185    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6ck4\" (UniqueName: \"kubernetes.io/projected/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-kube-api-access-k6ck4\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.702266 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.702196    5101 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-home\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.702266 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.702205    5101 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5-dshm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.722518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.722451    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"]
Oct 30 16:38:13.736305 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.736280    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg"]
Oct 30 16:38:13.770627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.770592    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"]
Oct 30 16:38:13.776634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.776605    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd"]
Oct 30 16:38:13.988764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.988669    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 16:38:13.988764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:13.988755    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 16:38:14.324444 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:14.324306    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-2-w6-063dcc-kserve-84868dd955-7sfbd" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:14.372626 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:14.372568    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/distinct-w6-063dcc-kserve-78f8b44656-kp2qg" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:14.993692 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:14.993663    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:14.994127 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:14.993977    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:14.994767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:14.994748    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:38:15.085580 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:15.085534    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" path="/var/lib/kubelet/pods/2fc7c872-ab93-48ad-ad9a-bbdef04b79d5/volumes"
Oct 30 16:38:15.086402 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:15.086377    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69393570-3f04-4e1b-be5b-214719fc9189" path="/var/lib/kubelet/pods/69393570-3f04-4e1b-be5b-214719fc9189/volumes"
Oct 30 16:38:15.247407 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:15.247280    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:16.984601 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:16.984561    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:17.674474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:17.674444    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:18.545995 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.545956    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"]
Oct 30 16:38:18.629185 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.629144    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"]
Oct 30 16:38:18.630689 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.630662    5101 cpu_manager.go:414] "containerMap: removing container" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main"
Oct 30 16:38:18.630854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.630827    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main"
Oct 30 16:38:18.630974 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.630861    5101 cpu_manager.go:414] "containerMap: removing container" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main"
Oct 30 16:38:18.630974 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.630870    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main"
Oct 30 16:38:18.631132 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.631115    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="69393570-3f04-4e1b-be5b-214719fc9189" containerName="main"
Oct 30 16:38:18.631190 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.631137    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="2fc7c872-ab93-48ad-ad9a-bbdef04b79d5" containerName="main"
Oct 30 16:38:18.637858 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.637839    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.667639 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.663479    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"]
Oct 30 16:38:18.731620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.731572    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:18.788428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.788397    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.788582 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.788515    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f15653-50b0-4b80-ab46-e23d01705c60-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.788650 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.788635    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.788697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.788685    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.788808 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.788787    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f15653-50b0-4b80-ab46-e23d01705c60-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.788882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.788841    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2r6\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-kube-api-access-hr2r6\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.788941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.788887    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.789004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.788986    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.789069 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.789056    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.890561 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.890525    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2r6\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-kube-api-access-hr2r6\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.890740 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.890581    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.890740 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.890634    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.890740 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.890694    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.890898 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.890797    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.890898 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.890878    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f15653-50b0-4b80-ab46-e23d01705c60-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.891026 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.891008    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.891086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.891060    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.891142 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.891083    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.891197 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.891139    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f15653-50b0-4b80-ab46-e23d01705c60-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.891458 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.891412    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.891587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.891458    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.901183 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.892259    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.901183 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.892652    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f15653-50b0-4b80-ab46-e23d01705c60-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.911871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.911844    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.912100 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.912074    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f15653-50b0-4b80-ab46-e23d01705c60-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.964249 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.964172    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2r6\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-kube-api-access-hr2r6\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.977206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.965018    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-g7955\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:18.977206 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:18.965681    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:19.275428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:19.273641    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:19.692816 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:38:19.692026    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f15653_50b0_4b80_ab46_e23d01705c60.slice/crio-ed42f9d02249097c7c7a543977751b75749e5158a60a490c24a8ab04a3805c3d WatchSource:0}: Error finding container ed42f9d02249097c7c7a543977751b75749e5158a60a490c24a8ab04a3805c3d: Status 404 returned error can't find the container with id ed42f9d02249097c7c7a543977751b75749e5158a60a490c24a8ab04a3805c3d
Oct 30 16:38:19.695329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:19.695259    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:38:19.695479 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:19.695395    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:38:19.695479 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:19.695444    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:38:19.697219 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:19.697186    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"]
Oct 30 16:38:19.722808 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:19.722784    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" event={"ID":"75f15653-50b0-4b80-ab46-e23d01705c60","Type":"ContainerStarted","Data":"ed42f9d02249097c7c7a543977751b75749e5158a60a490c24a8ab04a3805c3d"}
Oct 30 16:38:20.297417 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:20.297380    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:38:20.731114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:20.731077    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" event={"ID":"75f15653-50b0-4b80-ab46-e23d01705c60","Type":"ContainerStarted","Data":"52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57"}
Oct 30 16:38:20.803893 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:20.803838    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podStartSLOduration=2.803825524 podStartE2EDuration="2.803825524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:38:20.803113658 +0000 UTC m=+1119.856391270" watchObservedRunningTime="2026-10-30 16:38:20.803825524 +0000 UTC m=+1119.857103135"
Oct 30 16:38:20.822020 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:20.821980    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:21.275011 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:21.274977    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:21.276304 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:21.276279    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 16:38:21.276436 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:21.276329    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 16:38:22.274918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.274884    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 16:38:22.275551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.274935    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 16:38:22.340074 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.340044    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"]
Oct 30 16:38:22.374971 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.374923    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"]
Oct 30 16:38:22.375437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.375382    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.391957 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.391911    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:38:22.403806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.403782    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:38:22.491050 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.491019    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.491265 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.491243    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zlb\" (UniqueName: \"kubernetes.io/projected/4723f170-0d72-4ec2-8dc6-0aceb8434f50-kube-api-access-42zlb\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.491387 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.491372    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.592962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.592886    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.592962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.592930    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42zlb\" (UniqueName: \"kubernetes.io/projected/4723f170-0d72-4ec2-8dc6-0aceb8434f50-kube-api-access-42zlb\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.593216 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.592964    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.596601 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.594007    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.596601 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.596509    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.617328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.617301    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zlb\" (UniqueName: \"kubernetes.io/projected/4723f170-0d72-4ec2-8dc6-0aceb8434f50-kube-api-access-42zlb\") pod \"maas-api-revoke-sub-b6ab5e6b-vps5j\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.710257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.710218    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:22.833519 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:22.832602    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:23.083409 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:23.083384    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"]
Oct 30 16:38:23.275094 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:23.275064    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 16:38:23.275504 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:23.275113    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 16:38:23.565364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:23.564412    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz" podUID="d9783b72-9bb5-43f0-845c-6a92a79cbdf5" containerName="payload-processing" containerID="cri-o://60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28" gracePeriod=25
Oct 30 16:38:23.783307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:23.783211    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j" event={"ID":"4723f170-0d72-4ec2-8dc6-0aceb8434f50","Type":"ContainerStarted","Data":"85dc006cb74b915c531bc76b574e52b8aef7ae1b04d6f875654bbe78195eb188"}
Oct 30 16:38:23.783307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:23.783276    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j" event={"ID":"4723f170-0d72-4ec2-8dc6-0aceb8434f50","Type":"ContainerStarted","Data":"3b513d89d3724351e9692b5e06bac763018eda79fcd1ccac8fb3bb2f97916072"}
Oct 30 16:38:23.823691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:23.823643    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j" podStartSLOduration=1.823629574 podStartE2EDuration="1.823629574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:38:23.82297635 +0000 UTC m=+1122.876253960" watchObservedRunningTime="2026-10-30 16:38:23.823629574 +0000 UTC m=+1122.876907223"
Oct 30 16:38:24.275190 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:24.275156    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 16:38:24.275597 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:24.275211    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 16:38:24.511982 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:24.511908    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:24.700405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:24.683370    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:24.797521 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:24.797437    5101 generic.go:356] "Generic (PLEG): container finished" podID="4723f170-0d72-4ec2-8dc6-0aceb8434f50" containerID="85dc006cb74b915c531bc76b574e52b8aef7ae1b04d6f875654bbe78195eb188" exitCode=0
Oct 30 16:38:24.797696 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:24.797522    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j" event={"ID":"4723f170-0d72-4ec2-8dc6-0aceb8434f50","Type":"ContainerDied","Data":"85dc006cb74b915c531bc76b574e52b8aef7ae1b04d6f875654bbe78195eb188"}
Oct 30 16:38:24.993421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:24.993386    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz" podUID="d9783b72-9bb5-43f0-845c-6a92a79cbdf5" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:38:25.274292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:25.274259    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 16:38:25.274488 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:25.274348    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 16:38:25.987324 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:25.987293    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:26.086884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.086796    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-xks-ca\") pod \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") "
Oct 30 16:38:26.087189 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.086902    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-openshift-ca\") pod \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") "
Oct 30 16:38:26.087189 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.087074    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4723f170-0d72-4ec2-8dc6-0aceb8434f50-kube-api-access-42zlb\" (UniqueName: \"kubernetes.io/projected/4723f170-0d72-4ec2-8dc6-0aceb8434f50-kube-api-access-42zlb\") pod \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\" (UID: \"4723f170-0d72-4ec2-8dc6-0aceb8434f50\") "
Oct 30 16:38:26.087851 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.087825    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-openshift-ca" pod "4723f170-0d72-4ec2-8dc6-0aceb8434f50" (UID: "4723f170-0d72-4ec2-8dc6-0aceb8434f50"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:26.089753 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.089720    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-xks-ca" pod "4723f170-0d72-4ec2-8dc6-0aceb8434f50" (UID: "4723f170-0d72-4ec2-8dc6-0aceb8434f50"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:26.089963 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.089939    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4723f170-0d72-4ec2-8dc6-0aceb8434f50-kube-api-access-42zlb" pod "4723f170-0d72-4ec2-8dc6-0aceb8434f50" (UID: "4723f170-0d72-4ec2-8dc6-0aceb8434f50"). InnerVolumeSpecName "kube-api-access-42zlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:26.189858 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.189769    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:26.189858 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.189803    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4723f170-0d72-4ec2-8dc6-0aceb8434f50-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:26.189858 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.189818    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42zlb\" (UniqueName: \"kubernetes.io/projected/4723f170-0d72-4ec2-8dc6-0aceb8434f50-kube-api-access-42zlb\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:26.274352 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.274300    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 16:38:26.274521 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.274395    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 16:38:26.718674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.718639    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:26.837281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.837233    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j" event={"ID":"4723f170-0d72-4ec2-8dc6-0aceb8434f50","Type":"ContainerDied","Data":"3b513d89d3724351e9692b5e06bac763018eda79fcd1ccac8fb3bb2f97916072"}
Oct 30 16:38:26.837541 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.837368    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b513d89d3724351e9692b5e06bac763018eda79fcd1ccac8fb3bb2f97916072"
Oct 30 16:38:26.837541 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:26.837473    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"
Oct 30 16:38:27.279508 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:27.279473    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:27.279940 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:27.279917    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:27.280587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:27.280565    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:38:27.942591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:27.942536    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" containerID="cri-o://5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db" gracePeriod=45
Oct 30 16:38:28.049861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.049825    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": dial tcp 10.132.0.70:8000: connect: connection refused"
Oct 30 16:38:28.240713 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.240687    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:38:28.328032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.327996    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-home\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-home\") pod \"972f1924-be45-45b9-bede-b0b6416224c3\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") "
Oct 30 16:38:28.328595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.328117    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/972f1924-be45-45b9-bede-b0b6416224c3-tls-certs\" (UniqueName: \"kubernetes.io/secret/972f1924-be45-45b9-bede-b0b6416224c3-tls-certs\") pod \"972f1924-be45-45b9-bede-b0b6416224c3\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") "
Oct 30 16:38:28.328595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.328171    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-tmp-dir\") pod \"972f1924-be45-45b9-bede-b0b6416224c3\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") "
Oct 30 16:38:28.328595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.328285    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-model-cache\") pod \"972f1924-be45-45b9-bede-b0b6416224c3\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") "
Oct 30 16:38:28.328595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.328294    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-home" pod "972f1924-be45-45b9-bede-b0b6416224c3" (UID: "972f1924-be45-45b9-bede-b0b6416224c3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:28.328595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.328417    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/972f1924-be45-45b9-bede-b0b6416224c3-kube-api-access-7dvgz\" (UniqueName: \"kubernetes.io/projected/972f1924-be45-45b9-bede-b0b6416224c3-kube-api-access-7dvgz\") pod \"972f1924-be45-45b9-bede-b0b6416224c3\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") "
Oct 30 16:38:28.328595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.328534    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-dshm\") pod \"972f1924-be45-45b9-bede-b0b6416224c3\" (UID: \"972f1924-be45-45b9-bede-b0b6416224c3\") "
Oct 30 16:38:28.328595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.328561    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-tmp-dir" pod "972f1924-be45-45b9-bede-b0b6416224c3" (UID: "972f1924-be45-45b9-bede-b0b6416224c3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:28.328972 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.328650    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-model-cache" pod "972f1924-be45-45b9-bede-b0b6416224c3" (UID: "972f1924-be45-45b9-bede-b0b6416224c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:28.329478 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.329453    5101 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-tmp-dir\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.329598 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.329481    5101 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-model-cache\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.329598 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.329497    5101 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-home\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.331463 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.331435    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-dshm" pod "972f1924-be45-45b9-bede-b0b6416224c3" (UID: "972f1924-be45-45b9-bede-b0b6416224c3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:28.331565 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.331534    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/972f1924-be45-45b9-bede-b0b6416224c3-kube-api-access-7dvgz" pod "972f1924-be45-45b9-bede-b0b6416224c3" (UID: "972f1924-be45-45b9-bede-b0b6416224c3"). InnerVolumeSpecName "kube-api-access-7dvgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:28.331647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.331627    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/972f1924-be45-45b9-bede-b0b6416224c3-tls-certs" pod "972f1924-be45-45b9-bede-b0b6416224c3" (UID: "972f1924-be45-45b9-bede-b0b6416224c3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:28.430886 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.430846    5101 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/972f1924-be45-45b9-bede-b0b6416224c3-tls-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.430886 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.430880    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dvgz\" (UniqueName: \"kubernetes.io/projected/972f1924-be45-45b9-bede-b0b6416224c3-kube-api-access-7dvgz\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.430886 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.430892    5101 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/972f1924-be45-45b9-bede-b0b6416224c3-dshm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.546088 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.546014    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:28.852742 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.852661    5101 generic.go:356] "Generic (PLEG): container finished" podID="972f1924-be45-45b9-bede-b0b6416224c3" containerID="5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db" exitCode=0
Oct 30 16:38:28.852742 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.852707    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"
Oct 30 16:38:28.852939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.852751    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" event={"ID":"972f1924-be45-45b9-bede-b0b6416224c3","Type":"ContainerDied","Data":"5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db"}
Oct 30 16:38:28.852939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.852793    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp" event={"ID":"972f1924-be45-45b9-bede-b0b6416224c3","Type":"ContainerDied","Data":"aef54ce9be60172bed60c0fb70fcef52a832c0d495fd73c836a5db1b8e3c8725"}
Oct 30 16:38:28.852939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.852818    5101 scope.go:122] "RemoveContainer" containerID="5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db"
Oct 30 16:38:28.863966 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.863948    5101 scope.go:122] "RemoveContainer" containerID="5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db"
Oct 30 16:38:28.864225 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:28.864210    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db\": container with ID starting with 5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db not found: ID does not exist" containerID="5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db"
Oct 30 16:38:28.864321 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.864231    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db"} err="failed to get container status \"5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db\": rpc error: code = NotFound desc = could not find container \"5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db\": container with ID starting with 5a7910cabee033188c07f3d1b3a41360e2d2f0f0e28ddfafeccf41fd58cdd0db not found: ID does not exist"
Oct 30 16:38:28.905808 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.905784    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"]
Oct 30 16:38:28.918101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:28.918078    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/distinct-w2-3e4f91-kserve-54f8b68c-c89jp"]
Oct 30 16:38:29.076732 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:29.076702    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="972f1924-be45-45b9-bede-b0b6416224c3" path="/var/lib/kubelet/pods/972f1924-be45-45b9-bede-b0b6416224c3/volumes"
Oct 30 16:38:29.425417 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:29.425382    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"]
Oct 30 16:38:29.616666 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:29.616626    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:30.327792 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:30.327756    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:30.600096 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:30.600010    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:32.233452 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:32.233090    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:33.256362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:33.256313    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:33.472392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:33.447270    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:33.722362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:33.702987    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:33.832479 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:33.832432    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.038417 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:34.031555    5101 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.391478 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:34.391427    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.471184 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:34.470448    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.607865 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:34.605919    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:34.877456 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:34.857012    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:38:34.877456 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:34.858324    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:38:35.000365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:34.991439    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:35.101378 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:35.082563    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz" podUID="d9783b72-9bb5-43f0-845c-6a92a79cbdf5" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:38:35.485360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:35.481385    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 16:38:35.631364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:35.627817    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.90:8000/ready\": context deadline exceeded"
Oct 30 16:38:35.861523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:35.861411    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:35.999693 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:35.999658    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:38:36.002914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:36.002891    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:38:36.053384 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:36.046862    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:38:36.103385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:36.102996    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:38:36.126983 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:36.126907    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:38:36.155221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:36.155186    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:36.325400 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:36.324203    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:36.551622 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:36.551592    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:36.727841 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:36.727808    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:37.152935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:37.152905    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:37.464416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:37.464296    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"]
Oct 30 16:38:37.465606 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:37.464826    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l" podUID="201c113a-cdd6-44bd-852a-0b530655ac7d" containerName="maas-api" containerID="cri-o://49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4" gracePeriod=30
Oct 30 16:38:37.565522 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:37.565483    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:38.145146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.145112    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:38.313654 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.313609    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:38.823100 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.823052    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:38.829460 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.829425    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:38:38.884575 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.873478    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/201c113a-cdd6-44bd-852a-0b530655ac7d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/201c113a-cdd6-44bd-852a-0b530655ac7d-openshift-service-ca\") pod \"201c113a-cdd6-44bd-852a-0b530655ac7d\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") "
Oct 30 16:38:38.884575 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.873647    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls\") pod \"201c113a-cdd6-44bd-852a-0b530655ac7d\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") "
Oct 30 16:38:38.884575 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.873766    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-metrics-certs\") pod \"201c113a-cdd6-44bd-852a-0b530655ac7d\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") "
Oct 30 16:38:38.884575 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.873910    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/201c113a-cdd6-44bd-852a-0b530655ac7d-kube-api-access-b9xfn\" (UniqueName: \"kubernetes.io/projected/201c113a-cdd6-44bd-852a-0b530655ac7d-kube-api-access-b9xfn\") pod \"201c113a-cdd6-44bd-852a-0b530655ac7d\" (UID: \"201c113a-cdd6-44bd-852a-0b530655ac7d\") "
Oct 30 16:38:38.884575 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.875223    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/201c113a-cdd6-44bd-852a-0b530655ac7d-openshift-service-ca" pod "201c113a-cdd6-44bd-852a-0b530655ac7d" (UID: "201c113a-cdd6-44bd-852a-0b530655ac7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:38.885500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.885444    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/201c113a-cdd6-44bd-852a-0b530655ac7d-kube-api-access-b9xfn" pod "201c113a-cdd6-44bd-852a-0b530655ac7d" (UID: "201c113a-cdd6-44bd-852a-0b530655ac7d"). InnerVolumeSpecName "kube-api-access-b9xfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:38.886114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.886076    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls" pod "201c113a-cdd6-44bd-852a-0b530655ac7d" (UID: "201c113a-cdd6-44bd-852a-0b530655ac7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:38.886739 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.886721    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-metrics-certs" pod "201c113a-cdd6-44bd-852a-0b530655ac7d" (UID: "201c113a-cdd6-44bd-852a-0b530655ac7d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:38.976105 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.976077    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-maas-api-tls\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:38.976105 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.976111    5101 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/201c113a-cdd6-44bd-852a-0b530655ac7d-metrics-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:38.976297 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.976122    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9xfn\" (UniqueName: \"kubernetes.io/projected/201c113a-cdd6-44bd-852a-0b530655ac7d-kube-api-access-b9xfn\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:38.976297 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:38.976131    5101 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/201c113a-cdd6-44bd-852a-0b530655ac7d-openshift-service-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:39.353884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.353651    5101 generic.go:356] "Generic (PLEG): container finished" podID="201c113a-cdd6-44bd-852a-0b530655ac7d" containerID="49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4" exitCode=0
Oct 30 16:38:39.353884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.353725    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"
Oct 30 16:38:39.353884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.353723    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l" event={"ID":"201c113a-cdd6-44bd-852a-0b530655ac7d","Type":"ContainerDied","Data":"49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4"}
Oct 30 16:38:39.353884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.353823    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l" event={"ID":"201c113a-cdd6-44bd-852a-0b530655ac7d","Type":"ContainerDied","Data":"dc4ac43d4486c37f608b88f578ffd34d4754dd14ab6681b18107a2eb801aced3"}
Oct 30 16:38:39.353884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.353842    5101 scope.go:122] "RemoveContainer" containerID="49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4"
Oct 30 16:38:39.364974 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.364953    5101 scope.go:122] "RemoveContainer" containerID="49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4"
Oct 30 16:38:39.365243 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:39.365224    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4\": container with ID starting with 49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4 not found: ID does not exist" containerID="49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4"
Oct 30 16:38:39.365297 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.365252    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4"} err="failed to get container status \"49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4\": rpc error: code = NotFound desc = could not find container \"49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4\": container with ID starting with 49b82ff84fdc99a80c561b4c8a81627a0c2e69adf6dbe719000e95fa3c3c3bb4 not found: ID does not exist"
Oct 30 16:38:39.406839 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.406816    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"]
Oct 30 16:38:39.418319 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:39.418292    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-3e4f91-5bd67b45f8-gx25l"]
Oct 30 16:38:40.335559 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:40.335513    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:41.086136 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.086107    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="201c113a-cdd6-44bd-852a-0b530655ac7d" path="/var/lib/kubelet/pods/201c113a-cdd6-44bd-852a-0b530655ac7d/volumes"
Oct 30 16:38:41.741638 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.741602    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:41.803603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.803567    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"]
Oct 30 16:38:41.804603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804575    5101 cpu_manager.go:414] "containerMap: removing container" podUID="4723f170-0d72-4ec2-8dc6-0aceb8434f50" containerName="revoke-keys"
Oct 30 16:38:41.804603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804601    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4723f170-0d72-4ec2-8dc6-0aceb8434f50" containerName="revoke-keys"
Oct 30 16:38:41.804813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804639    5101 cpu_manager.go:414] "containerMap: removing container" podUID="201c113a-cdd6-44bd-852a-0b530655ac7d" containerName="maas-api"
Oct 30 16:38:41.804813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804648    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="201c113a-cdd6-44bd-852a-0b530655ac7d" containerName="maas-api"
Oct 30 16:38:41.804813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804703    5101 cpu_manager.go:414] "containerMap: removing container" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main"
Oct 30 16:38:41.804813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804711    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main"
Oct 30 16:38:41.805042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804852    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="972f1924-be45-45b9-bede-b0b6416224c3" containerName="main"
Oct 30 16:38:41.805042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804871    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="4723f170-0d72-4ec2-8dc6-0aceb8434f50" containerName="revoke-keys"
Oct 30 16:38:41.805042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.804885    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="201c113a-cdd6-44bd-852a-0b530655ac7d" containerName="maas-api"
Oct 30 16:38:41.813215 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.813192    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:41.841077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.841037    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"]
Oct 30 16:38:41.847323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.847179    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:38:41.847323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.847179    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:38:41.917404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.917315    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv2mc\" (UniqueName: \"kubernetes.io/projected/d543d0df-154c-49b3-a9f6-57ae324ce1bb-kube-api-access-mv2mc\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:41.917643 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.917609    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:41.917773 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.917727    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:41.938764 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:41.938732    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:42.010463 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.008475    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"]
Oct 30 16:38:42.010463 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.008741    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" containerID="cri-o://5a82009f38ad520dcb5db7a0cb743a80b9d72609393a07b7b5a42f7a4618394a" gracePeriod=30
Oct 30 16:38:42.021391 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.013517    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"]
Oct 30 16:38:42.021391 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.013704    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" containerID="cri-o://ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222" gracePeriod=30
Oct 30 16:38:42.021391 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.021328    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:42.021704 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.021468    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:42.021704 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.021581    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv2mc\" (UniqueName: \"kubernetes.io/projected/d543d0df-154c-49b3-a9f6-57ae324ce1bb-kube-api-access-mv2mc\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:42.028522 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.028146    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:42.029085 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.029062    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:42.036646 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.036623    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"]
Oct 30 16:38:42.036984 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.036960    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" containerID="cri-o://19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a" gracePeriod=30
Oct 30 16:38:42.050693 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.050667    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv2mc\" (UniqueName: \"kubernetes.io/projected/d543d0df-154c-49b3-a9f6-57ae324ce1bb-kube-api-access-mv2mc\") pod \"maas-api-revoke-sub-5b0c572c-pczwc\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:42.135860 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.135831    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:42.143511 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.143474    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:42.280667 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.280572    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:42.487361 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:42.480636    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"]
Oct 30 16:38:42.491102 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:38:42.490263    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd543d0df_154c_49b3_a9f6_57ae324ce1bb.slice/crio-785feadddc69d6bd4fd1c4757cd8da8cd62adde758763251cf0618e908e25e36 WatchSource:0}: Error finding container 785feadddc69d6bd4fd1c4757cd8da8cd62adde758763251cf0618e908e25e36: Status 404 returned error can't find the container with id 785feadddc69d6bd4fd1c4757cd8da8cd62adde758763251cf0618e908e25e36
Oct 30 16:38:43.431930 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.431900    5101 generic.go:356] "Generic (PLEG): container finished" podID="d543d0df-154c-49b3-a9f6-57ae324ce1bb" containerID="d3f40f6d6c5fde4b4d5e9ef808e87b341d4268d24218bf829ec05339dc17b843" exitCode=0
Oct 30 16:38:43.432318 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.431980    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc" event={"ID":"d543d0df-154c-49b3-a9f6-57ae324ce1bb","Type":"ContainerDied","Data":"d3f40f6d6c5fde4b4d5e9ef808e87b341d4268d24218bf829ec05339dc17b843"}
Oct 30 16:38:43.432318 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.432042    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc" event={"ID":"d543d0df-154c-49b3-a9f6-57ae324ce1bb","Type":"ContainerStarted","Data":"785feadddc69d6bd4fd1c4757cd8da8cd62adde758763251cf0618e908e25e36"}
Oct 30 16:38:43.670453 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.670425    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:43.876767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.876740    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:38:43.961147 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.961053    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-plugins-config-volume\") pod \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\" (UID: \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\") "
Oct 30 16:38:43.961350 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.961320    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-kube-api-access-llntn\" (UniqueName: \"kubernetes.io/projected/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-kube-api-access-llntn\") pod \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\" (UID: \"d9783b72-9bb5-43f0-845c-6a92a79cbdf5\") "
Oct 30 16:38:43.961534 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.961510    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-plugins-config-volume" pod "d9783b72-9bb5-43f0-845c-6a92a79cbdf5" (UID: "d9783b72-9bb5-43f0-845c-6a92a79cbdf5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:43.963878 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.963852    5101 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-plugins-config-volume\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:43.964204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.964176    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:38:43.964301 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.964240    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:38:43.965471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:43.965431    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-kube-api-access-llntn" pod "d9783b72-9bb5-43f0-845c-6a92a79cbdf5" (UID: "d9783b72-9bb5-43f0-845c-6a92a79cbdf5"). InnerVolumeSpecName "kube-api-access-llntn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:44.062693 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.062653    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Oct 30 16:38:44.062903 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.062730    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:38:44.065200 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.065168    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:44.067556 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.066603    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llntn\" (UniqueName: \"kubernetes.io/projected/d9783b72-9bb5-43f0-845c-6a92a79cbdf5-kube-api-access-llntn\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.142123 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.142081    5101 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:38:44.142771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.142735    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:38:44.439452 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.439419    5101 generic.go:356] "Generic (PLEG): container finished" podID="d9783b72-9bb5-43f0-845c-6a92a79cbdf5" containerID="60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28" exitCode=0
Oct 30 16:38:44.439891 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.439476    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"
Oct 30 16:38:44.439891 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.439502    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz" event={"ID":"d9783b72-9bb5-43f0-845c-6a92a79cbdf5","Type":"ContainerDied","Data":"60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28"}
Oct 30 16:38:44.439891 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.439553    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz" event={"ID":"d9783b72-9bb5-43f0-845c-6a92a79cbdf5","Type":"ContainerDied","Data":"9586d0d928c2771b6998819999546513f9fd47e5c2e31d91c4eaa55f26b65f23"}
Oct 30 16:38:44.439891 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.439575    5101 scope.go:122] "RemoveContainer" containerID="60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28"
Oct 30 16:38:44.449078 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.449052    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main" containerID="cri-o://b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7" gracePeriod=45
Oct 30 16:38:44.452571 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.452551    5101 scope.go:122] "RemoveContainer" containerID="60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28"
Oct 30 16:38:44.452908 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:44.452881    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28\": container with ID starting with 60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28 not found: ID does not exist" containerID="60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28"
Oct 30 16:38:44.452981 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.452921    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28"} err="failed to get container status \"60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28\": rpc error: code = NotFound desc = could not find container \"60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28\": container with ID starting with 60119098175bde1d3d78c85c703d505e26fcdf6d9f62f31e784663308eabbb28 not found: ID does not exist"
Oct 30 16:38:44.492765 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.492727    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"]
Oct 30 16:38:44.504710 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.504683    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-3e4f91-67ffb5db59-spmjz"]
Oct 30 16:38:44.635996 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.635967    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:44.738922 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.738887    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:38:44.782080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.782046    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d543d0df-154c-49b3-a9f6-57ae324ce1bb-kube-api-access-mv2mc\" (UniqueName: \"kubernetes.io/projected/d543d0df-154c-49b3-a9f6-57ae324ce1bb-kube-api-access-mv2mc\") pod \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") "
Oct 30 16:38:44.782303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.782106    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-openshift-ca\") pod \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") "
Oct 30 16:38:44.782411 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.782325    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-xks-ca\") pod \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\" (UID: \"d543d0df-154c-49b3-a9f6-57ae324ce1bb\") "
Oct 30 16:38:44.782632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.782587    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-openshift-ca" pod "d543d0df-154c-49b3-a9f6-57ae324ce1bb" (UID: "d543d0df-154c-49b3-a9f6-57ae324ce1bb"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:44.783098 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.783071    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.784989 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.784966    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d543d0df-154c-49b3-a9f6-57ae324ce1bb-kube-api-access-mv2mc" pod "d543d0df-154c-49b3-a9f6-57ae324ce1bb" (UID: "d543d0df-154c-49b3-a9f6-57ae324ce1bb"). InnerVolumeSpecName "kube-api-access-mv2mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:44.785724 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.785701    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-xks-ca" pod "d543d0df-154c-49b3-a9f6-57ae324ce1bb" (UID: "d543d0df-154c-49b3-a9f6-57ae324ce1bb"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:44.883978 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.883940    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e898eb0-fb8e-4109-b1ed-70c86e747f29-kube-api-access-zjqr2\" (UniqueName: \"kubernetes.io/projected/4e898eb0-fb8e-4109-b1ed-70c86e747f29-kube-api-access-zjqr2\") pod \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") "
Oct 30 16:38:44.884438 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.884407    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-model-cache\") pod \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") "
Oct 30 16:38:44.884571 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.884467    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-home\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-home\") pod \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") "
Oct 30 16:38:44.884643 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.884628    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-dshm\") pod \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") "
Oct 30 16:38:44.884747 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.884733    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tmp-dir\") pod \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") "
Oct 30 16:38:44.884822 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.884808    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tls-certs\") pod \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\" (UID: \"4e898eb0-fb8e-4109-b1ed-70c86e747f29\") "
Oct 30 16:38:44.885482 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.885463    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv2mc\" (UniqueName: \"kubernetes.io/projected/d543d0df-154c-49b3-a9f6-57ae324ce1bb-kube-api-access-mv2mc\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.885609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.885596    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d543d0df-154c-49b3-a9f6-57ae324ce1bb-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.885700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.885669    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-home" pod "4e898eb0-fb8e-4109-b1ed-70c86e747f29" (UID: "4e898eb0-fb8e-4109-b1ed-70c86e747f29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.885847 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.885823    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tmp-dir" pod "4e898eb0-fb8e-4109-b1ed-70c86e747f29" (UID: "4e898eb0-fb8e-4109-b1ed-70c86e747f29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.885943 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.885917    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-model-cache" pod "4e898eb0-fb8e-4109-b1ed-70c86e747f29" (UID: "4e898eb0-fb8e-4109-b1ed-70c86e747f29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.888612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.888241    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-dshm" pod "4e898eb0-fb8e-4109-b1ed-70c86e747f29" (UID: "4e898eb0-fb8e-4109-b1ed-70c86e747f29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.888612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.888312    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e898eb0-fb8e-4109-b1ed-70c86e747f29-kube-api-access-zjqr2" pod "4e898eb0-fb8e-4109-b1ed-70c86e747f29" (UID: "4e898eb0-fb8e-4109-b1ed-70c86e747f29"). InnerVolumeSpecName "kube-api-access-zjqr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:44.888612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.888546    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tls-certs" pod "4e898eb0-fb8e-4109-b1ed-70c86e747f29" (UID: "4e898eb0-fb8e-4109-b1ed-70c86e747f29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:44.987754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.987674    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjqr2\" (UniqueName: \"kubernetes.io/projected/4e898eb0-fb8e-4109-b1ed-70c86e747f29-kube-api-access-zjqr2\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.987754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.987705    5101 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-model-cache\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.987754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.987713    5101 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-home\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.987754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.987723    5101 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-dshm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.987754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.987731    5101 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tmp-dir\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.987754 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:44.987739    5101 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e898eb0-fb8e-4109-b1ed-70c86e747f29-tls-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:45.078939 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.078905    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9783b72-9bb5-43f0-845c-6a92a79cbdf5" path="/var/lib/kubelet/pods/d9783b72-9bb5-43f0-845c-6a92a79cbdf5/volumes"
Oct 30 16:38:45.450074 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.450040    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"
Oct 30 16:38:45.450567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.450050    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc" event={"ID":"d543d0df-154c-49b3-a9f6-57ae324ce1bb","Type":"ContainerDied","Data":"785feadddc69d6bd4fd1c4757cd8da8cd62adde758763251cf0618e908e25e36"}
Oct 30 16:38:45.450567 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.450184    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="785feadddc69d6bd4fd1c4757cd8da8cd62adde758763251cf0618e908e25e36"
Oct 30 16:38:45.457424 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.457396    5101 generic.go:356] "Generic (PLEG): container finished" podID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerID="b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7" exitCode=0
Oct 30 16:38:45.457570 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.457454    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"
Oct 30 16:38:45.457570 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.457467    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" event={"ID":"4e898eb0-fb8e-4109-b1ed-70c86e747f29","Type":"ContainerDied","Data":"b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7"}
Oct 30 16:38:45.457570 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.457494    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x" event={"ID":"4e898eb0-fb8e-4109-b1ed-70c86e747f29","Type":"ContainerDied","Data":"562643a28ede8aff71b8190316673061c7abcb29d74ded1ec1a4da9360daf458"}
Oct 30 16:38:45.457570 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.457517    5101 scope.go:122] "RemoveContainer" containerID="b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7"
Oct 30 16:38:45.469611 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.469592    5101 scope.go:122] "RemoveContainer" containerID="b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7"
Oct 30 16:38:45.469907 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:45.469889    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7\": container with ID starting with b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7 not found: ID does not exist" containerID="b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7"
Oct 30 16:38:45.469986 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.469914    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7"} err="failed to get container status \"b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7\": rpc error: code = NotFound desc = could not find container \"b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7\": container with ID starting with b4fe0e2ccc6ff7091fa3be6306b6a95bfb285cf3dba3b139bcc30997f4095ae7 not found: ID does not exist"
Oct 30 16:38:45.508190 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.508153    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"]
Oct 30 16:38:45.519658 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.519633    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/distinct-w5-2e0784-kserve-589968b5d8-pz42x"]
Oct 30 16:38:45.758697 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.758585    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:45.907839 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:45.907793    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:46.045412 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.045153    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"]
Oct 30 16:38:46.045581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.045451    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy" containerID="cri-o://00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2" gracePeriod=30
Oct 30 16:38:46.054980 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.054828    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"]
Oct 30 16:38:46.063813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.063772    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" containerID="cri-o://4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f" gracePeriod=30
Oct 30 16:38:46.073885 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.072681    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"]
Oct 30 16:38:46.075070 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.074421    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy" containerID="cri-o://96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a" gracePeriod=30
Oct 30 16:38:46.080174 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.079783    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"]
Oct 30 16:38:46.080644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.080615    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy" containerID="cri-o://7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d" gracePeriod=30
Oct 30 16:38:46.089871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.089477    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:38:46.089871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.089534    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:38:46.129688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:46.129609    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:47.078440 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.078410    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" path="/var/lib/kubelet/pods/4e898eb0-fb8e-4109-b1ed-70c86e747f29/volumes"
Oct 30 16:38:47.283078 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.283036    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:47.363600 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.363566    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:38:47.399937 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.399915    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:38:47.428648 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.428611    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-token\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-token\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.428835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.428688    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-socket\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.428835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.428732    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-kube-api-access-2klk5\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-kube-api-access-2klk5\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.428835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.428762    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-envoy\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.428835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.428800    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-podinfo\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.429058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.428935    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-data\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.429058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.428989    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-certs\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.429058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.429006    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istiod-ca-cert\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.429058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.429040    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-credential-socket\") pod \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\" (UID: \"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead\") "
Oct 30 16:38:47.430029 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.429999    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-credential-socket" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.431233 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.430988    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istiod-ca-cert" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:47.431233 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.431201    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-data" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.431620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.431598    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-socket" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.432769 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.432740    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-envoy" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.436529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.436506    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"]
Oct 30 16:38:47.437247 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437217    5101 cpu_manager.go:414] "containerMap: removing container" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main"
Oct 30 16:38:47.437247 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437241    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main"
Oct 30 16:38:47.437405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437264    5101 cpu_manager.go:414] "containerMap: removing container" podUID="d9783b72-9bb5-43f0-845c-6a92a79cbdf5" containerName="payload-processing"
Oct 30 16:38:47.437405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437271    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9783b72-9bb5-43f0-845c-6a92a79cbdf5" containerName="payload-processing"
Oct 30 16:38:47.437405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437284    5101 cpu_manager.go:414] "containerMap: removing container" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy"
Oct 30 16:38:47.437405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437289    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy"
Oct 30 16:38:47.437405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437300    5101 cpu_manager.go:414] "containerMap: removing container" podUID="d543d0df-154c-49b3-a9f6-57ae324ce1bb" containerName="revoke-keys"
Oct 30 16:38:47.437405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437304    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d543d0df-154c-49b3-a9f6-57ae324ce1bb" containerName="revoke-keys"
Oct 30 16:38:47.437405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437326    5101 cpu_manager.go:414] "containerMap: removing container" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy"
Oct 30 16:38:47.437405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437334    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy"
Oct 30 16:38:47.437678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437506    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="d543d0df-154c-49b3-a9f6-57ae324ce1bb" containerName="revoke-keys"
Oct 30 16:38:47.437678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437520    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerName="istio-proxy"
Oct 30 16:38:47.437678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437530    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e898eb0-fb8e-4109-b1ed-70c86e747f29" containerName="main"
Oct 30 16:38:47.437678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437537    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9783b72-9bb5-43f0-845c-6a92a79cbdf5" containerName="payload-processing"
Oct 30 16:38:47.437678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.437543    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="f70aff9e-427f-4343-b246-a08e911519d4" containerName="istio-proxy"
Oct 30 16:38:47.438980 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.438959    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-certs" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.441348 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.441324    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.443146 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.443126    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-token" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.443273 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.443243    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-podinfo" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:47.444572 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.444551    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-kube-api-access-2klk5" pod "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" (UID: "16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead"). InnerVolumeSpecName "kube-api-access-2klk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.459229 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.459190    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:38:47.461437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.459210    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:38:47.461437 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.460579    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"]
Oct 30 16:38:47.486854 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.486822    5101 generic.go:356] "Generic (PLEG): container finished" podID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" containerID="19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a" exitCode=0
Oct 30 16:38:47.487086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.487069    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"
Oct 30 16:38:47.487252 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.486902    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" event={"ID":"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead","Type":"ContainerDied","Data":"19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a"}
Oct 30 16:38:47.487328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.487293    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s" event={"ID":"16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead","Type":"ContainerDied","Data":"4caf665b1bb522980177fb032141c11aa7cc471ba53f09e7348b8bcdd6e4fd1c"}
Oct 30 16:38:47.487328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.487318    5101 scope.go:122] "RemoveContainer" containerID="19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a"
Oct 30 16:38:47.490271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.490244    5101 generic.go:356] "Generic (PLEG): container finished" podID="8ee6c933-ab35-4907-a710-4040ab161613" containerID="5a82009f38ad520dcb5db7a0cb743a80b9d72609393a07b7b5a42f7a4618394a" exitCode=0
Oct 30 16:38:47.490624 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.490515    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" event={"ID":"8ee6c933-ab35-4907-a710-4040ab161613","Type":"ContainerDied","Data":"5a82009f38ad520dcb5db7a0cb743a80b9d72609393a07b7b5a42f7a4618394a"}
Oct 30 16:38:47.494819 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.494785    5101 generic.go:356] "Generic (PLEG): container finished" podID="f70aff9e-427f-4343-b246-a08e911519d4" containerID="ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222" exitCode=0
Oct 30 16:38:47.494940 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.494865    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" event={"ID":"f70aff9e-427f-4343-b246-a08e911519d4","Type":"ContainerDied","Data":"ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222"}
Oct 30 16:38:47.494940 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.494904    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx" event={"ID":"f70aff9e-427f-4343-b246-a08e911519d4","Type":"ContainerDied","Data":"fa0167d0e5e3b5d39e694df3e5e7fd4ef38345cfc8ca2beec29774e14609969a"}
Oct 30 16:38:47.495055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.494969    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"
Oct 30 16:38:47.499715 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.499696    5101 scope.go:122] "RemoveContainer" containerID="19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a"
Oct 30 16:38:47.499970 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:47.499951    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a\": container with ID starting with 19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a not found: ID does not exist" containerID="19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a"
Oct 30 16:38:47.500039 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.499977    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a"} err="failed to get container status \"19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a\": rpc error: code = NotFound desc = could not find container \"19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a\": container with ID starting with 19776bb9d0fa6e9680c3a86d531f1b9c0ff32d734b79410060ab90ae9f8fa70a not found: ID does not exist"
Oct 30 16:38:47.500039 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.499994    5101 scope.go:122] "RemoveContainer" containerID="137df567b009af4acfcda748cf64b7c144403b2907c73145fe9dd913d9103893"
Oct 30 16:38:47.516271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.516250    5101 scope.go:122] "RemoveContainer" containerID="ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222"
Oct 30 16:38:47.526587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.526569    5101 scope.go:122] "RemoveContainer" containerID="ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222"
Oct 30 16:38:47.526860 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:47.526836    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222\": container with ID starting with ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222 not found: ID does not exist" containerID="ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222"
Oct 30 16:38:47.526940 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.526869    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222"} err="failed to get container status \"ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222\": rpc error: code = NotFound desc = could not find container \"ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222\": container with ID starting with ae674d2897c4300934f694b7bd5bab86b910ddd1cf46b1e23b9639147cf09222 not found: ID does not exist"
Oct 30 16:38:47.530555 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530529    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-certs\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.530647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530614    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-socket\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.530707 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530671    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-data\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.530770 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530746    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-kube-api-access-kxp75\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-kube-api-access-kxp75\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.530821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530805    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-credential-socket\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.530877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530809    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-certs" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.530920 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530875    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-data" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.530920 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530887    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f70aff9e-427f-4343-b246-a08e911519d4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70aff9e-427f-4343-b246-a08e911519d4-istiod-ca-cert\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.530920 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530891    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-socket" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.531053 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.530981    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-envoy\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.531053 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.531023    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-credential-socket" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.531053 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.531035    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-istio-token\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-istio-token\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.531202 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.531087    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f70aff9e-427f-4343-b246-a08e911519d4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70aff9e-427f-4343-b246-a08e911519d4-istio-podinfo\") pod \"f70aff9e-427f-4343-b246-a08e911519d4\" (UID: \"f70aff9e-427f-4343-b246-a08e911519d4\") "
Oct 30 16:38:47.531304 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.531274    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f70aff9e-427f-4343-b246-a08e911519d4-istiod-ca-cert" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:47.531405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.531378    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.531529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.531509    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.531861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.531832    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjb4b\" (UniqueName: \"kubernetes.io/projected/6f39ffcd-2842-4b7d-b763-24343d59a474-kube-api-access-zjb4b\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.532030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532012    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532037    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532053    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2klk5\" (UniqueName: \"kubernetes.io/projected/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-kube-api-access-2klk5\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532067    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532080    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532101 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532092    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532105    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532117    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532129    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532142    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532153    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532166    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532178    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532192    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70aff9e-427f-4343-b246-a08e911519d4-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.532969 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.532944    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-kube-api-access-kxp75" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "kube-api-access-kxp75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.533205 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.533179    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f70aff9e-427f-4343-b246-a08e911519d4-istio-podinfo" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:47.533627 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.533600    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-envoy" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.534202 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.534187    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-istio-token" pod "f70aff9e-427f-4343-b246-a08e911519d4" (UID: "f70aff9e-427f-4343-b246-a08e911519d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.576964 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.576876    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"]
Oct 30 16:38:47.580768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.580737    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-m9m7s"]
Oct 30 16:38:47.633616 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.633583    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.633793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.633753    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.634033 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.634013    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjb4b\" (UniqueName: \"kubernetes.io/projected/6f39ffcd-2842-4b7d-b763-24343d59a474-kube-api-access-zjb4b\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.634581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.634133    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70aff9e-427f-4343-b246-a08e911519d4-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.634581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.634152    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.634581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.634165    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70aff9e-427f-4343-b246-a08e911519d4-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.634581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.634181    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxp75\" (UniqueName: \"kubernetes.io/projected/f70aff9e-427f-4343-b246-a08e911519d4-kube-api-access-kxp75\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.635269 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.635237    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.638261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.638235    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.658944 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.658921    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjb4b\" (UniqueName: \"kubernetes.io/projected/6f39ffcd-2842-4b7d-b763-24343d59a474-kube-api-access-zjb4b\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.731820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.731793    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:38:47.767985 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.767955    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:47.818655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.818619    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:47.845782 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.845683    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ee6c933-ab35-4907-a710-4040ab161613-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ee6c933-ab35-4907-a710-4040ab161613-istiod-ca-cert\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.845965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.845784    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-data\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.845965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.845886    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-envoy\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.845965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.845931    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-credential-socket\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.846124 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.846008    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-kube-api-access-47t7d\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-kube-api-access-47t7d\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.846124 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.846047    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8ee6c933-ab35-4907-a710-4040ab161613-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ee6c933-ab35-4907-a710-4040ab161613-istio-podinfo\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.846124 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.846112    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-certs\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.846276 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.846171    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-istio-token\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-istio-token\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.846276 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.846216    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-socket\") pod \"8ee6c933-ab35-4907-a710-4040ab161613\" (UID: \"8ee6c933-ab35-4907-a710-4040ab161613\") "
Oct 30 16:38:47.848288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.846947    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-credential-socket" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.848288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.847294    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee6c933-ab35-4907-a710-4040ab161613-istiod-ca-cert" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:47.848288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.847536    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-data" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.849312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.849283    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-certs" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.849484 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.849431    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-socket" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.849701 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.849685    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ee6c933-ab35-4907-a710-4040ab161613-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.849771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.849713    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.849771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.849727    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.849771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.849742    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.849771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.849756    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.855162 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.850874    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-envoy" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.858458 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.857430    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-kube-api-access-47t7d" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "kube-api-access-47t7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.873863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.873747    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-istio-token" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.876962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.876629    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"]
Oct 30 16:38:47.884718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.884547    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ee6c933-ab35-4907-a710-4040ab161613-istio-podinfo" pod "8ee6c933-ab35-4907-a710-4040ab161613" (UID: "8ee6c933-ab35-4907-a710-4040ab161613"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:47.892690 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.892660    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-qpnnx"]
Oct 30 16:38:47.951647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.951600    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ee6c933-ab35-4907-a710-4040ab161613-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.951647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.951633    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47t7d\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-kube-api-access-47t7d\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.951647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.951643    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ee6c933-ab35-4907-a710-4040ab161613-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.951647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:47.951653    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ee6c933-ab35-4907-a710-4040ab161613-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:48.108179 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:38:48.108125    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f39ffcd_2842_4b7d_b763_24343d59a474.slice/crio-e3c6dc32efd28f96196ba4119e1fa424886f58809ac9f3ecc2f1b0bc51901c18 WatchSource:0}: Error finding container e3c6dc32efd28f96196ba4119e1fa424886f58809ac9f3ecc2f1b0bc51901c18: Status 404 returned error can't find the container with id e3c6dc32efd28f96196ba4119e1fa424886f58809ac9f3ecc2f1b0bc51901c18
Oct 30 16:38:48.109223 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.109195    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"]
Oct 30 16:38:48.504931 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.504896    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"
Oct 30 16:38:48.504931 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.504921    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc" event={"ID":"8ee6c933-ab35-4907-a710-4040ab161613","Type":"ContainerDied","Data":"60f054253f6c2665512256edf725fe5d2cfbc087369d28e8b2ff3935a85b760f"}
Oct 30 16:38:48.505166 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.504980    5101 scope.go:122] "RemoveContainer" containerID="5a82009f38ad520dcb5db7a0cb743a80b9d72609393a07b7b5a42f7a4618394a"
Oct 30 16:38:48.506288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.506266    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k" event={"ID":"6f39ffcd-2842-4b7d-b763-24343d59a474","Type":"ContainerStarted","Data":"e3c6dc32efd28f96196ba4119e1fa424886f58809ac9f3ecc2f1b0bc51901c18"}
Oct 30 16:38:48.558719 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.558691    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"]
Oct 30 16:38:48.569984 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.569961    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-b6bxc"]
Oct 30 16:38:48.969402 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.969370    5101 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:38:48.969544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:48.969428    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:38:49.077309 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:49.077278    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead" path="/var/lib/kubelet/pods/16d2a6e8-c68b-4be6-8c2b-6a8bcdb90ead/volumes"
Oct 30 16:38:49.077881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:49.077863    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ee6c933-ab35-4907-a710-4040ab161613" path="/var/lib/kubelet/pods/8ee6c933-ab35-4907-a710-4040ab161613/volumes"
Oct 30 16:38:49.078577 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:49.078561    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f70aff9e-427f-4343-b246-a08e911519d4" path="/var/lib/kubelet/pods/f70aff9e-427f-4343-b246-a08e911519d4/volumes"
Oct 30 16:38:49.515413 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:49.515377    5101 generic.go:356] "Generic (PLEG): container finished" podID="6f39ffcd-2842-4b7d-b763-24343d59a474" containerID="e562b71579dd3eec8cb4ed2acb715abe2fcf3baa4e6e326b2c2c4c523dff7b91" exitCode=0
Oct 30 16:38:49.515831 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:49.515433    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k" event={"ID":"6f39ffcd-2842-4b7d-b763-24343d59a474","Type":"ContainerDied","Data":"e562b71579dd3eec8cb4ed2acb715abe2fcf3baa4e6e326b2c2c4c523dff7b91"}
Oct 30 16:38:49.950368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:49.950316    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:50.297046 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:50.296965    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:38:50.485297 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.485264    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:50.644464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.644410    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:50.744616 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.744592    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:50.895476 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.895446    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-openshift-ca\") pod \"6f39ffcd-2842-4b7d-b763-24343d59a474\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") "
Oct 30 16:38:50.895619 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.895518    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f39ffcd-2842-4b7d-b763-24343d59a474-kube-api-access-zjb4b\" (UniqueName: \"kubernetes.io/projected/6f39ffcd-2842-4b7d-b763-24343d59a474-kube-api-access-zjb4b\") pod \"6f39ffcd-2842-4b7d-b763-24343d59a474\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") "
Oct 30 16:38:50.895796 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.895774    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-xks-ca\") pod \"6f39ffcd-2842-4b7d-b763-24343d59a474\" (UID: \"6f39ffcd-2842-4b7d-b763-24343d59a474\") "
Oct 30 16:38:50.895868 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.895848    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-openshift-ca" pod "6f39ffcd-2842-4b7d-b763-24343d59a474" (UID: "6f39ffcd-2842-4b7d-b763-24343d59a474"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:50.896421 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.896401    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:50.897785 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.897764    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-xks-ca" pod "6f39ffcd-2842-4b7d-b763-24343d59a474" (UID: "6f39ffcd-2842-4b7d-b763-24343d59a474"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:50.897862 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.897799    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f39ffcd-2842-4b7d-b763-24343d59a474-kube-api-access-zjb4b" pod "6f39ffcd-2842-4b7d-b763-24343d59a474" (UID: "6f39ffcd-2842-4b7d-b763-24343d59a474"). InnerVolumeSpecName "kube-api-access-zjb4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:50.998270 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.998241    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6f39ffcd-2842-4b7d-b763-24343d59a474-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:50.998270 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:50.998268    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjb4b\" (UniqueName: \"kubernetes.io/projected/6f39ffcd-2842-4b7d-b763-24343d59a474-kube-api-access-zjb4b\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.058273 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.058234    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:51.418363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.412539    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:38:51.500474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.500448    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:38:51.504561 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.504535    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:38:51.509533 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.509505    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:38:51.515147 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515120    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-envoy\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.515259 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515171    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-certs\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.515259 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515249    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-socket\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.515404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515379    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-podinfo\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.515460 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515432    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-token\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-token\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.515535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515512    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istiod-ca-cert\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.515603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515571    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-credential-socket\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.515712 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515688    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-socket" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.515894 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515871    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-credential-socket" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.515973 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515920    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-certs" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.515973 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515630    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-kube-api-access-4g72n\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-kube-api-access-4g72n\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.516073 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.515971    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istiod-ca-cert" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:51.516073 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.516016    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-data\") pod \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\" (UID: \"d9c26e27-640d-4d7b-b99b-f572e6edbc9c\") "
Oct 30 16:38:51.516235 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.516218    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-data" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.516967 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.516940    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.517133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.516970    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.517133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.516985    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.517133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.516997    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.517133 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.517010    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.517808 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.517783    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-envoy" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.518044 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.518019    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-kube-api-access-4g72n" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "kube-api-access-4g72n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.518136 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.518112    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-podinfo" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:51.518252 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.518237    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-token" pod "d9c26e27-640d-4d7b-b99b-f572e6edbc9c" (UID: "d9c26e27-640d-4d7b-b99b-f572e6edbc9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.570534 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.570498    5101 generic.go:356] "Generic (PLEG): container finished" podID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerID="7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d" exitCode=0
Oct 30 16:38:51.570718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.570603    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" event={"ID":"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f","Type":"ContainerDied","Data":"7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d"}
Oct 30 16:38:51.570718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.570651    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq" event={"ID":"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f","Type":"ContainerDied","Data":"75ec6ca9187d31f6edebcc0934c8b1f5d0f4a6f407ec7380bbceae64ec31e7f4"}
Oct 30 16:38:51.570718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.570680    5101 scope.go:122] "RemoveContainer" containerID="7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d"
Oct 30 16:38:51.570924 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.570775    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"
Oct 30 16:38:51.573179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.572859    5101 generic.go:356] "Generic (PLEG): container finished" podID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerID="96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a" exitCode=0
Oct 30 16:38:51.573179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.572939    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" event={"ID":"d9c26e27-640d-4d7b-b99b-f572e6edbc9c","Type":"ContainerDied","Data":"96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a"}
Oct 30 16:38:51.573179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.572983    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl" event={"ID":"d9c26e27-640d-4d7b-b99b-f572e6edbc9c","Type":"ContainerDied","Data":"7d5bbff4d3de8f4946d9eefbe00d4eaad4fbf3b185434a9ad87eee5b5825ec5e"}
Oct 30 16:38:51.573179 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.573055    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"
Oct 30 16:38:51.575226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.575198    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k" event={"ID":"6f39ffcd-2842-4b7d-b763-24343d59a474","Type":"ContainerDied","Data":"e3c6dc32efd28f96196ba4119e1fa424886f58809ac9f3ecc2f1b0bc51901c18"}
Oct 30 16:38:51.575399 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.575255    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3c6dc32efd28f96196ba4119e1fa424886f58809ac9f3ecc2f1b0bc51901c18"
Oct 30 16:38:51.575399 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.575310    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"
Oct 30 16:38:51.578714 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.578689    5101 generic.go:356] "Generic (PLEG): container finished" podID="9b826731-4760-4a92-959d-3219a4465021" containerID="00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2" exitCode=0
Oct 30 16:38:51.578792 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.578764    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" event={"ID":"9b826731-4760-4a92-959d-3219a4465021","Type":"ContainerDied","Data":"00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2"}
Oct 30 16:38:51.578828 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.578802    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn" event={"ID":"9b826731-4760-4a92-959d-3219a4465021","Type":"ContainerDied","Data":"34989564b0bedaa43c0fd40b1653931985ba022c308a809c2c42c8cf9bbe8530"}
Oct 30 16:38:51.578896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.578883    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"
Oct 30 16:38:51.581866 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.581021    5101 generic.go:356] "Generic (PLEG): container finished" podID="0776caf0-db6e-4466-af81-9c6147083465" containerID="4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f" exitCode=0
Oct 30 16:38:51.581866 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.581043    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" event={"ID":"0776caf0-db6e-4466-af81-9c6147083465","Type":"ContainerDied","Data":"4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f"}
Oct 30 16:38:51.581866 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.581074    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7" event={"ID":"0776caf0-db6e-4466-af81-9c6147083465","Type":"ContainerDied","Data":"45dfb3a4b445fd2dbc9e3e09bfd4cce0a98582e3fe9f9a3b31a0f97175e5cdb6"}
Oct 30 16:38:51.584428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.582941    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"
Oct 30 16:38:51.591102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.591083    5101 scope.go:122] "RemoveContainer" containerID="7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d"
Oct 30 16:38:51.591416 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:51.591396    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d\": container with ID starting with 7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d not found: ID does not exist" containerID="7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d"
Oct 30 16:38:51.591507 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.591427    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d"} err="failed to get container status \"7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d\": rpc error: code = NotFound desc = could not find container \"7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d\": container with ID starting with 7f70ac98ff686d49339aa3c903514cda5ab6c66d260687b7839b6ff0f0d09b2d not found: ID does not exist"
Oct 30 16:38:51.591507 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.591460    5101 scope.go:122] "RemoveContainer" containerID="96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a"
Oct 30 16:38:51.605368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.605334    5101 scope.go:122] "RemoveContainer" containerID="96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a"
Oct 30 16:38:51.605703 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:51.605685    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a\": container with ID starting with 96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a not found: ID does not exist" containerID="96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a"
Oct 30 16:38:51.605793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.605714    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a"} err="failed to get container status \"96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a\": rpc error: code = NotFound desc = could not find container \"96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a\": container with ID starting with 96cb698222afc979436324af83e2aa0965bb1db3f11983c480b1b16f4b7e2d3a not found: ID does not exist"
Oct 30 16:38:51.605793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.605734    5101 scope.go:122] "RemoveContainer" containerID="00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2"
Oct 30 16:38:51.616371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.616317    5101 scope.go:122] "RemoveContainer" containerID="530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1"
Oct 30 16:38:51.617540 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617517    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-socket\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.617630 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617557    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0776caf0-db6e-4466-af81-9c6147083465-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0776caf0-db6e-4466-af81-9c6147083465-istiod-ca-cert\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.617630 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617582    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-data\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.617630 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617610    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0776caf0-db6e-4466-af81-9c6147083465-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0776caf0-db6e-4466-af81-9c6147083465-istio-podinfo\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.617773 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617642    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-credential-socket\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.617773 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617680    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-envoy\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.617941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617773    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-socket" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.617941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617778    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-certs\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.617941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617884    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b826731-4760-4a92-959d-3219a4465021-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b826731-4760-4a92-959d-3219a4465021-istiod-ca-cert\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.618082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617944    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-socket\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.618082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617965    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-certs" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.618082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.617980    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-envoy\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.618082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618041    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-kube-api-access-ssng8\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-kube-api-access-ssng8\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.618274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618131    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-credential-socket\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.618274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618183    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-credential-socket\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.618274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618210    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-data\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.618274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618222    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0776caf0-db6e-4466-af81-9c6147083465-istiod-ca-cert" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:51.618274 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618270    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9b826731-4760-4a92-959d-3219a4465021-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b826731-4760-4a92-959d-3219a4465021-istio-podinfo\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.618532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618305    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-certs\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.618532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618335    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-istio-token\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-istio-token\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.618532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618420    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-kube-api-access-8k5qn\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-kube-api-access-8k5qn\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.618532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618424    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-data" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.618532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618454    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-certs\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.618532 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618515    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-podinfo\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.618843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618554    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-envoy\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.618843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618597    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-kube-api-access-tgzr8\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-kube-api-access-tgzr8\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.618843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618646    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-istio-token\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-istio-token\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.618843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618695    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-socket\") pod \"9b826731-4760-4a92-959d-3219a4465021\" (UID: \"9b826731-4760-4a92-959d-3219a4465021\") "
Oct 30 16:38:51.618843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618749    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istiod-ca-cert\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.618843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618774    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-credential-socket" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.618843 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618801    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-data\") pod \"0776caf0-db6e-4466-af81-9c6147083465\" (UID: \"0776caf0-db6e-4466-af81-9c6147083465\") "
Oct 30 16:38:51.619196 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.618851    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-token\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-token\") pod \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\" (UID: \"fb8fd1f9-6435-4037-b524-0f3e0cf59a9f\") "
Oct 30 16:38:51.620985 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.620640    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b826731-4760-4a92-959d-3219a4465021-istiod-ca-cert" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:51.620985 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.620808    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0776caf0-db6e-4466-af81-9c6147083465-istio-podinfo" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:51.620985 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.620893    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-certs" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.621191 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.621033    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-credential-socket" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.621245 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.621226    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-socket" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.621990 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.621829    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-credential-socket" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.622423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.622124    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-data" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.623171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.622888    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-socket" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.623765 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.623734    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-kube-api-access-8k5qn" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "kube-api-access-8k5qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.624021 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.623993    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istiod-ca-cert" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:51.624202 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.624184    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-data" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.637170 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.637148    5101 scope.go:122] "RemoveContainer" containerID="00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2"
Oct 30 16:38:51.637905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.637862    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-certs" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.638821 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:51.638103    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2\": container with ID starting with 00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2 not found: ID does not exist" containerID="00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2"
Oct 30 16:38:51.638821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.638222    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2"} err="failed to get container status \"00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2\": rpc error: code = NotFound desc = could not find container \"00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2\": container with ID starting with 00dcc10e26e2fa5ab2a1a3b2fe9bbf7ac64e85cf60febe9f650bf71e2525d3e2 not found: ID does not exist"
Oct 30 16:38:51.638821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.638252    5101 scope.go:122] "RemoveContainer" containerID="530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1"
Oct 30 16:38:51.640398 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:51.639960    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1\": container with ID starting with 530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1 not found: ID does not exist" containerID="530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1"
Oct 30 16:38:51.640398 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.640134    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1"} err="failed to get container status \"530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1\": rpc error: code = NotFound desc = could not find container \"530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1\": container with ID starting with 530ca294dc2d4f704d29c7451ab1124d15a06c90ffd102e089caed6ae8b42ed1 not found: ID does not exist"
Oct 30 16:38:51.640398 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.640155    5101 scope.go:122] "RemoveContainer" containerID="4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f"
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644294    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644323    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b826731-4760-4a92-959d-3219a4465021-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644366    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644380    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g72n\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-kube-api-access-4g72n\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644395    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644409    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644588    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644602    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644615    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k5qn\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-kube-api-access-8k5qn\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644630    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644648    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644777    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644792    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644807    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644824    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644838    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9c26e27-640d-4d7b-b99b-f572e6edbc9c-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.644849    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.645013    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0776caf0-db6e-4466-af81-9c6147083465-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.645031    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.645044    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0776caf0-db6e-4466-af81-9c6147083465-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.645087 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.645057    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671062    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-envoy" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671096    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-istio-token" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671146    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-kube-api-access-ssng8" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "kube-api-access-ssng8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671208    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-istio-token" pod "0776caf0-db6e-4466-af81-9c6147083465" (UID: "0776caf0-db6e-4466-af81-9c6147083465"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671238    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-envoy" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671284    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-envoy" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671310    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b826731-4760-4a92-959d-3219a4465021-istio-podinfo" pod "9b826731-4760-4a92-959d-3219a4465021" (UID: "9b826731-4760-4a92-959d-3219a4465021"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671399    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-kube-api-access-tgzr8" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "kube-api-access-tgzr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.671768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.671452    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-podinfo" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:51.673048 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.673026    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-token" pod "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" (UID: "fb8fd1f9-6435-4037-b524-0f3e0cf59a9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.680165 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.680143    5101 scope.go:122] "RemoveContainer" containerID="4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f"
Oct 30 16:38:51.680520 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:38:51.680498    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f\": container with ID starting with 4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f not found: ID does not exist" containerID="4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f"
Oct 30 16:38:51.680612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.680532    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f"} err="failed to get container status \"4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f\": rpc error: code = NotFound desc = could not find container \"4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f\": container with ID starting with 4a5a8047b5d0fca3508247a594933cd67a2611c377b1c137faa3af367c3cd41f not found: ID does not exist"
Oct 30 16:38:51.720153 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.720128    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"]
Oct 30 16:38:51.724177 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.724150    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-96wpl"]
Oct 30 16:38:51.729777 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.729756    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:51.746761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746712    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b826731-4760-4a92-959d-3219a4465021-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746733    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746743    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0776caf0-db6e-4466-af81-9c6147083465-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746751    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgzr8\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-kube-api-access-tgzr8\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746760    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746768    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746997 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746776    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746997 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746784    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b826731-4760-4a92-959d-3219a4465021-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746997 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746791    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssng8\" (UniqueName: \"kubernetes.io/projected/0776caf0-db6e-4466-af81-9c6147083465-kube-api-access-ssng8\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.746997 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.746799    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b826731-4760-4a92-959d-3219a4465021-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.923879 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.923854    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"]
Oct 30 16:38:51.928593 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.928566    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-zm2fq"]
Oct 30 16:38:51.952753 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.952719    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:51.967075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.967028    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"]
Oct 30 16:38:51.974715 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:51.974684    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-hnnvn"]
Oct 30 16:38:52.009933 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:52.009854    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"]
Oct 30 16:38:52.018773 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:52.018737    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-rtxr7"]
Oct 30 16:38:52.349285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:52.349183    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:53.075861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:53.075829    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0776caf0-db6e-4466-af81-9c6147083465" path="/var/lib/kubelet/pods/0776caf0-db6e-4466-af81-9c6147083465/volumes"
Oct 30 16:38:53.076304 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:53.076290    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b826731-4760-4a92-959d-3219a4465021" path="/var/lib/kubelet/pods/9b826731-4760-4a92-959d-3219a4465021/volumes"
Oct 30 16:38:53.076769 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:53.076755    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" path="/var/lib/kubelet/pods/d9c26e27-640d-4d7b-b99b-f572e6edbc9c/volumes"
Oct 30 16:38:53.077508 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:53.077493    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" path="/var/lib/kubelet/pods/fb8fd1f9-6435-4037-b524-0f3e0cf59a9f/volumes"
Oct 30 16:38:53.720572 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:53.720538    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:55.423882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:55.423848    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:55.580128 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:55.580097    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:57.204967 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:57.204928    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:58.128598 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:58.128566    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:58.285960 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:58.285924    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:58.450003 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:58.449939    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:58.865015 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:58.864925    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:38:59.416288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:38:59.416254    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:00.012405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.012156    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"]
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013495    5101 cpu_manager.go:414] "containerMap: removing container" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013531    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013570    5101 cpu_manager.go:414] "containerMap: removing container" podUID="6f39ffcd-2842-4b7d-b763-24343d59a474" containerName="revoke-keys"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013579    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f39ffcd-2842-4b7d-b763-24343d59a474" containerName="revoke-keys"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013616    5101 cpu_manager.go:414] "containerMap: removing container" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013626    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013653    5101 cpu_manager.go:414] "containerMap: removing container" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013660    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013676    5101 cpu_manager.go:414] "containerMap: removing container" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013684    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013697    5101 cpu_manager.go:414] "containerMap: removing container" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013705    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013717    5101 cpu_manager.go:414] "containerMap: removing container" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013724    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013893    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="0776caf0-db6e-4466-af81-9c6147083465" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013913    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013923    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb8fd1f9-6435-4037-b524-0f3e0cf59a9f" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013932    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9c26e27-640d-4d7b-b99b-f572e6edbc9c" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013948    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013962    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.013970    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f39ffcd-2842-4b7d-b763-24343d59a474" containerName="revoke-keys"
Oct 30 16:39:00.036366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.018626    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.062360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.060232    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:39:00.062360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.061015    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:39:00.087793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.071211    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.087793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.071285    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.087793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.071509    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkht4\" (UniqueName: \"kubernetes.io/projected/904c5e3c-a34f-4905-bcda-cb908a88e1c0-kube-api-access-dkht4\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.087793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.077166    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"]
Oct 30 16:39:00.376423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.347970    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkht4\" (UniqueName: \"kubernetes.io/projected/904c5e3c-a34f-4905-bcda-cb908a88e1c0-kube-api-access-dkht4\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.390373 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.376827    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.396368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.390644    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.422369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.397800    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.495899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.495864    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.661416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.641240    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkht4\" (UniqueName: \"kubernetes.io/projected/904c5e3c-a34f-4905-bcda-cb908a88e1c0-kube-api-access-dkht4\") pod \"maas-api-revoke-sub-5276b55f-9drkf\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.751363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.737623    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:00.809364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:00.773577    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"]
Oct 30 16:39:02.681486 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:02.655515    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"]
Oct 30 16:39:02.950367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:02.946735    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 16:39:02.994609 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:02.994549    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf" event={"ID":"904c5e3c-a34f-4905-bcda-cb908a88e1c0","Type":"ContainerStarted","Data":"a3f4150f1e7f99d679f1a9a90ff6e1b129c45dd7a691c53db31db257a029c2a4"}
Oct 30 16:39:04.004506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:04.004466    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf" event={"ID":"904c5e3c-a34f-4905-bcda-cb908a88e1c0","Type":"ContainerStarted","Data":"4870d6cf02a8cd9071c438678d9fa36db615bb24567d12d98e134f3be78fe1b8"}
Oct 30 16:39:04.052100 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:04.052047    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf" podStartSLOduration=5.052033749 podStartE2EDuration="5.052033749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:39:04.050442695 +0000 UTC m=+1163.103720305" watchObservedRunningTime="2026-10-30 16:39:04.052033749 +0000 UTC m=+1163.105311359"
Oct 30 16:39:05.014690 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:05.014650    5101 generic.go:356] "Generic (PLEG): container finished" podID="904c5e3c-a34f-4905-bcda-cb908a88e1c0" containerID="4870d6cf02a8cd9071c438678d9fa36db615bb24567d12d98e134f3be78fe1b8" exitCode=0
Oct 30 16:39:05.015108 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:05.014733    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf" event={"ID":"904c5e3c-a34f-4905-bcda-cb908a88e1c0","Type":"ContainerDied","Data":"4870d6cf02a8cd9071c438678d9fa36db615bb24567d12d98e134f3be78fe1b8"}
Oct 30 16:39:06.012556 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.012524    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"]
Oct 30 16:39:06.045064 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.045031    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"]
Oct 30 16:39:06.202900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.202876    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:06.283930 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.283842    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"]
Oct 30 16:39:06.285625 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.285583    5101 cpu_manager.go:414] "containerMap: removing container" podUID="904c5e3c-a34f-4905-bcda-cb908a88e1c0" containerName="revoke-keys"
Oct 30 16:39:06.285625 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.285613    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="904c5e3c-a34f-4905-bcda-cb908a88e1c0" containerName="revoke-keys"
Oct 30 16:39:06.285849 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.285640    5101 cpu_manager.go:414] "containerMap: removing container" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy"
Oct 30 16:39:06.285849 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.285648    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ee6c933-ab35-4907-a710-4040ab161613" containerName="istio-proxy"
Oct 30 16:39:06.285849 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.285786    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b826731-4760-4a92-959d-3219a4465021" containerName="istio-proxy"
Oct 30 16:39:06.285849 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.285804    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="904c5e3c-a34f-4905-bcda-cb908a88e1c0" containerName="revoke-keys"
Oct 30 16:39:06.290401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.290370    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.306529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.306499    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-xks-ca\") pod \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") "
Oct 30 16:39:06.306726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.306708    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/904c5e3c-a34f-4905-bcda-cb908a88e1c0-kube-api-access-dkht4\" (UniqueName: \"kubernetes.io/projected/904c5e3c-a34f-4905-bcda-cb908a88e1c0-kube-api-access-dkht4\") pod \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") "
Oct 30 16:39:06.306812 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.306747    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-openshift-ca\") pod \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\" (UID: \"904c5e3c-a34f-4905-bcda-cb908a88e1c0\") "
Oct 30 16:39:06.307960 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.307899    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-openshift-ca" pod "904c5e3c-a34f-4905-bcda-cb908a88e1c0" (UID: "904c5e3c-a34f-4905-bcda-cb908a88e1c0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:06.317382 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.317354    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"]
Oct 30 16:39:06.318083 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.318055    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-xks-ca" pod "904c5e3c-a34f-4905-bcda-cb908a88e1c0" (UID: "904c5e3c-a34f-4905-bcda-cb908a88e1c0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:06.321051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.321030    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904c5e3c-a34f-4905-bcda-cb908a88e1c0-kube-api-access-dkht4" pod "904c5e3c-a34f-4905-bcda-cb908a88e1c0" (UID: "904c5e3c-a34f-4905-bcda-cb908a88e1c0"). InnerVolumeSpecName "kube-api-access-dkht4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:06.408525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.408486    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmpd5\" (UniqueName: \"kubernetes.io/projected/7c0406f0-7956-48bb-8a87-135ac4487eba-kube-api-access-tmpd5\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.408708 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.408678    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.408844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.408817    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.409027 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.409009    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkht4\" (UniqueName: \"kubernetes.io/projected/904c5e3c-a34f-4905-bcda-cb908a88e1c0-kube-api-access-dkht4\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:06.409082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.409036    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:06.409082 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.409052    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/904c5e3c-a34f-4905-bcda-cb908a88e1c0-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:06.510435 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.510403    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.510598 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.510577    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmpd5\" (UniqueName: \"kubernetes.io/projected/7c0406f0-7956-48bb-8a87-135ac4487eba-kube-api-access-tmpd5\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.510719 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.510702    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.511390 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.511371    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.512821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.512800    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.534213 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.534154    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmpd5\" (UniqueName: \"kubernetes.io/projected/7c0406f0-7956-48bb-8a87-135ac4487eba-kube-api-access-tmpd5\") pod \"maas-api-revoke-sub-ea7827dc-ml2jp\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.619527 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.619491    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:06.924659 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:06.924626    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"]
Oct 30 16:39:06.924783 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:39:06.924664    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0406f0_7956_48bb_8a87_135ac4487eba.slice/crio-6e7700b2f93907080c37c06ee1c14446530aaee070a30e45ce6e0a17c022c7a1 WatchSource:0}: Error finding container 6e7700b2f93907080c37c06ee1c14446530aaee070a30e45ce6e0a17c022c7a1: Status 404 returned error can't find the container with id 6e7700b2f93907080c37c06ee1c14446530aaee070a30e45ce6e0a17c022c7a1
Oct 30 16:39:07.030987 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:07.030952    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp" event={"ID":"7c0406f0-7956-48bb-8a87-135ac4487eba","Type":"ContainerStarted","Data":"6e7700b2f93907080c37c06ee1c14446530aaee070a30e45ce6e0a17c022c7a1"}
Oct 30 16:39:07.032408 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:07.032379    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf" event={"ID":"904c5e3c-a34f-4905-bcda-cb908a88e1c0","Type":"ContainerDied","Data":"a3f4150f1e7f99d679f1a9a90ff6e1b129c45dd7a691c53db31db257a029c2a4"}
Oct 30 16:39:07.032530 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:07.032410    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"
Oct 30 16:39:07.032530 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:07.032424    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3f4150f1e7f99d679f1a9a90ff6e1b129c45dd7a691c53db31db257a029c2a4"
Oct 30 16:39:07.744492 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:07.744449    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:07.925728 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:07.925689    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:08.039994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.039916    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp" event={"ID":"7c0406f0-7956-48bb-8a87-135ac4487eba","Type":"ContainerStarted","Data":"da26524119de7daaf0f4343d38a6b94fbc75bf73adea40d88939725dbc2f8a9e"}
Oct 30 16:39:08.084721 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.084652    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp" podStartSLOduration=2.084632314 podStartE2EDuration="2.084632314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:39:08.081808857 +0000 UTC m=+1167.135086469" watchObservedRunningTime="2026-10-30 16:39:08.084632314 +0000 UTC m=+1167.137909926"
Oct 30 16:39:08.187998 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.187961    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:08.371767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.371677    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"]
Oct 30 16:39:08.371947 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.371916    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" containerID="cri-o://befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe" gracePeriod=30
Oct 30 16:39:08.377375 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.377331    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"]
Oct 30 16:39:08.377581 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.377552    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" containerID="cri-o://0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69" gracePeriod=30
Oct 30 16:39:08.386077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.383501    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"]
Oct 30 16:39:08.386077 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.383744    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy" containerID="cri-o://f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813" gracePeriod=30
Oct 30 16:39:08.419564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.419529    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:08.900408 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:08.900331    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:09.056755 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:09.056713    5101 generic.go:356] "Generic (PLEG): container finished" podID="7c0406f0-7956-48bb-8a87-135ac4487eba" containerID="da26524119de7daaf0f4343d38a6b94fbc75bf73adea40d88939725dbc2f8a9e" exitCode=0
Oct 30 16:39:09.057006 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:09.056848    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp" event={"ID":"7c0406f0-7956-48bb-8a87-135ac4487eba","Type":"ContainerDied","Data":"da26524119de7daaf0f4343d38a6b94fbc75bf73adea40d88939725dbc2f8a9e"}
Oct 30 16:39:09.066119 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:09.066043    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:09.173648 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:09.173572    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:09.173648 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:09.173631    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:09.882402 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:09.882372    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:10.037656 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.037614    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:10.182673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.182639    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:10.230734 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.230710    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:10.275276 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.275234    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-xks-ca\") pod \"7c0406f0-7956-48bb-8a87-135ac4487eba\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") "
Oct 30 16:39:10.275472 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.275453    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c0406f0-7956-48bb-8a87-135ac4487eba-kube-api-access-tmpd5\" (UniqueName: \"kubernetes.io/projected/7c0406f0-7956-48bb-8a87-135ac4487eba-kube-api-access-tmpd5\") pod \"7c0406f0-7956-48bb-8a87-135ac4487eba\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") "
Oct 30 16:39:10.275551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.275531    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-openshift-ca\") pod \"7c0406f0-7956-48bb-8a87-135ac4487eba\" (UID: \"7c0406f0-7956-48bb-8a87-135ac4487eba\") "
Oct 30 16:39:10.276150 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.275915    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-openshift-ca" pod "7c0406f0-7956-48bb-8a87-135ac4487eba" (UID: "7c0406f0-7956-48bb-8a87-135ac4487eba"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:10.277708 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.277680    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-xks-ca" pod "7c0406f0-7956-48bb-8a87-135ac4487eba" (UID: "7c0406f0-7956-48bb-8a87-135ac4487eba"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:10.279538 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.279513    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c0406f0-7956-48bb-8a87-135ac4487eba-kube-api-access-tmpd5" pod "7c0406f0-7956-48bb-8a87-135ac4487eba" (UID: "7c0406f0-7956-48bb-8a87-135ac4487eba"). InnerVolumeSpecName "kube-api-access-tmpd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:10.377114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.377083    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:10.377114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.377110    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmpd5\" (UniqueName: \"kubernetes.io/projected/7c0406f0-7956-48bb-8a87-135ac4487eba-kube-api-access-tmpd5\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:10.377114 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:10.377120    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c0406f0-7956-48bb-8a87-135ac4487eba-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:11.013531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:11.013485    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs" podUID="07d3bc60-31d5-4cd8-9ce3-f8d78c380759" containerName="payload-processing" containerID="cri-o://5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809" gracePeriod=25
Oct 30 16:39:11.045502 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:11.045463    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd" podUID="ded8b30e-d48b-46cf-8398-8f9b80f09ebc" containerName="payload-pre-processing" containerID="cri-o://f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9" gracePeriod=25
Oct 30 16:39:11.062719 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:11.062693    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:11.092028 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:11.092001    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"
Oct 30 16:39:11.101982 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:11.101940    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp" event={"ID":"7c0406f0-7956-48bb-8a87-135ac4487eba","Type":"ContainerDied","Data":"6e7700b2f93907080c37c06ee1c14446530aaee070a30e45ce6e0a17c022c7a1"}
Oct 30 16:39:11.102119 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:11.101997    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e7700b2f93907080c37c06ee1c14446530aaee070a30e45ce6e0a17c022c7a1"
Oct 30 16:39:12.888392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:12.888313    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:12.888923 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:12.888417    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:13.039841 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.039805    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:13.207844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.207809    5101 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:13.208004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.207864    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:13.669461 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.669434    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:39:13.738539 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.738508    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:39:13.829540 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829460    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-certs\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.829712 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829579    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-credential-socket\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.829712 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829609    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-data\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.829712 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829647    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-envoy\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.829712 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829690    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-credential-socket\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.829934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829731    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/065cafa3-3491-45f6-97d6-c63d753d52d6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065cafa3-3491-45f6-97d6-c63d753d52d6-istiod-ca-cert\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.829934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829806    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-socket\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.829934 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829922    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-podinfo\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.830096 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.829954    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-istio-token\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-istio-token\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.830096 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830009    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-kube-api-access-smk25\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-kube-api-access-smk25\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.830096 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830039    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-token\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-token\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.830551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830096    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-kube-api-access-q7sqh\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-kube-api-access-q7sqh\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.830551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830215    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-envoy\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.830551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830269    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-socket\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.830551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830280    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-certs" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.830551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830322    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-certs\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.830868 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830595    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-data" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.830868 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830675    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-credential-socket" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.830976 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830783    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/065cafa3-3491-45f6-97d6-c63d753d52d6-istiod-ca-cert" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:13.830976 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830897    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-socket" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.830976 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830870    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-credential-socket" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.830976 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.830878    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-socket" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.831251 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.831215    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29cff232-c732-440a-bdc1-c18faddb48d9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cff232-c732-440a-bdc1-c18faddb48d9-istiod-ca-cert\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.831325 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.831293    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-data\") pod \"065cafa3-3491-45f6-97d6-c63d753d52d6\" (UID: \"065cafa3-3491-45f6-97d6-c63d753d52d6\") "
Oct 30 16:39:13.831413 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.831333    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/29cff232-c732-440a-bdc1-c18faddb48d9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cff232-c732-440a-bdc1-c18faddb48d9-istio-podinfo\") pod \"29cff232-c732-440a-bdc1-c18faddb48d9\" (UID: \"29cff232-c732-440a-bdc1-c18faddb48d9\") "
Oct 30 16:39:13.833109 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.832132    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.833109 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.832161    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.833109 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.832176    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.833109 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.832192    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/065cafa3-3491-45f6-97d6-c63d753d52d6-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.833109 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.832204    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.833109 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.832216    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.833109 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.832229    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.834819 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.834253    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-kube-api-access-q7sqh" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "kube-api-access-q7sqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:13.834819 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.834593    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29cff232-c732-440a-bdc1-c18faddb48d9-istiod-ca-cert" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:13.834987 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.834825    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-envoy" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.835178 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.835102    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-certs" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.835178 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.835142    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-data" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.835319 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.835272    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29cff232-c732-440a-bdc1-c18faddb48d9-istio-podinfo" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:13.835482 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.835455    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-envoy" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.835660 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.835637    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-kube-api-access-smk25" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "kube-api-access-smk25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:13.836962 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.836933    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-istio-token" pod "29cff232-c732-440a-bdc1-c18faddb48d9" (UID: "29cff232-c732-440a-bdc1-c18faddb48d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:13.837246 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.837229    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-podinfo" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:13.837745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.837720    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-token" pod "065cafa3-3491-45f6-97d6-c63d753d52d6" (UID: "065cafa3-3491-45f6-97d6-c63d753d52d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:13.893647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.893569    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:13.933832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933798    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cff232-c732-440a-bdc1-c18faddb48d9-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.933832 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933830    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933844    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cff232-c732-440a-bdc1-c18faddb48d9-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933856    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933867    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933878    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933888    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smk25\" (UniqueName: \"kubernetes.io/projected/29cff232-c732-440a-bdc1-c18faddb48d9-kube-api-access-smk25\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933900    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933913    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7sqh\" (UniqueName: \"kubernetes.io/projected/065cafa3-3491-45f6-97d6-c63d753d52d6-kube-api-access-q7sqh\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933925    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/065cafa3-3491-45f6-97d6-c63d753d52d6-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.934046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.933944    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cff232-c732-440a-bdc1-c18faddb48d9-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.986329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.986295    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs" podUID="07d3bc60-31d5-4cd8-9ce3-f8d78c380759" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:39:13.986329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:13.986198    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd" podUID="ded8b30e-d48b-46cf-8398-8f9b80f09ebc" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:39:14.089875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.089843    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:39:14.116292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.116259    5101 generic.go:356] "Generic (PLEG): container finished" podID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerID="0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69" exitCode=0
Oct 30 16:39:14.116489 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.116305    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"
Oct 30 16:39:14.116489 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.116357    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" event={"ID":"7af01b9f-4689-4c66-9965-c756e8dc00b8","Type":"ContainerDied","Data":"0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69"}
Oct 30 16:39:14.116489 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.116419    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq" event={"ID":"7af01b9f-4689-4c66-9965-c756e8dc00b8","Type":"ContainerDied","Data":"ed7e4d2510c8a477144c0be1254b07ba0174d27fb4904d22cdeeb469cc8cb73e"}
Oct 30 16:39:14.116489 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.116447    5101 scope.go:122] "RemoveContainer" containerID="0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69"
Oct 30 16:39:14.118354 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.118322    5101 generic.go:356] "Generic (PLEG): container finished" podID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerID="f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813" exitCode=0
Oct 30 16:39:14.118471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.118399    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" event={"ID":"065cafa3-3491-45f6-97d6-c63d753d52d6","Type":"ContainerDied","Data":"f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813"}
Oct 30 16:39:14.118471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.118421    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"
Oct 30 16:39:14.118471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.118464    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2" event={"ID":"065cafa3-3491-45f6-97d6-c63d753d52d6","Type":"ContainerDied","Data":"593660ed4f473cc34c7fa3d711f51cedd40bd758fabf6ae6a437e53dce769f5c"}
Oct 30 16:39:14.120135 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.120115    5101 generic.go:356] "Generic (PLEG): container finished" podID="29cff232-c732-440a-bdc1-c18faddb48d9" containerID="befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe" exitCode=0
Oct 30 16:39:14.120224 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.120150    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" event={"ID":"29cff232-c732-440a-bdc1-c18faddb48d9","Type":"ContainerDied","Data":"befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe"}
Oct 30 16:39:14.120285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.120212    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b" event={"ID":"29cff232-c732-440a-bdc1-c18faddb48d9","Type":"ContainerDied","Data":"494f737098bc093f0db5c0d8a699ad9f8b35a4bbc6daf7caeb06e431519a012d"}
Oct 30 16:39:14.120285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.120156    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"
Oct 30 16:39:14.131790 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.131768    5101 scope.go:122] "RemoveContainer" containerID="0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69"
Oct 30 16:39:14.132233 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:14.132203    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69\": container with ID starting with 0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69 not found: ID does not exist" containerID="0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69"
Oct 30 16:39:14.132323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.132244    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69"} err="failed to get container status \"0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69\": rpc error: code = NotFound desc = could not find container \"0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69\": container with ID starting with 0d50a268b759ebab474bad88d3be8f6b0ad92050f07284b1e9cb858ad5f9af69 not found: ID does not exist"
Oct 30 16:39:14.132323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.132281    5101 scope.go:122] "RemoveContainer" containerID="f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813"
Oct 30 16:39:14.157601 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.157560    5101 scope.go:122] "RemoveContainer" containerID="db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2"
Oct 30 16:39:14.174700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.174670    5101 scope.go:122] "RemoveContainer" containerID="f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813"
Oct 30 16:39:14.175216 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:14.175186    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813\": container with ID starting with f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813 not found: ID does not exist" containerID="f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813"
Oct 30 16:39:14.175308 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.175230    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813"} err="failed to get container status \"f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813\": rpc error: code = NotFound desc = could not find container \"f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813\": container with ID starting with f02048157078f8fa9a597a5f2ec4b764494e069211a16f070a6ca3a6e83f2813 not found: ID does not exist"
Oct 30 16:39:14.175308 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.175266    5101 scope.go:122] "RemoveContainer" containerID="db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2"
Oct 30 16:39:14.176053 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:14.176018    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2\": container with ID starting with db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2 not found: ID does not exist" containerID="db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2"
Oct 30 16:39:14.176160 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.176061    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2"} err="failed to get container status \"db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2\": rpc error: code = NotFound desc = could not find container \"db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2\": container with ID starting with db424890ea0a9618d87594acc993084509e187cc5d1975380d33ea9d0096bac2 not found: ID does not exist"
Oct 30 16:39:14.176160 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.176089    5101 scope.go:122] "RemoveContainer" containerID="befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe"
Oct 30 16:39:14.190026 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.190000    5101 scope.go:122] "RemoveContainer" containerID="befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe"
Oct 30 16:39:14.190348 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:14.190311    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe\": container with ID starting with befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe not found: ID does not exist" containerID="befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe"
Oct 30 16:39:14.190426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.190361    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe"} err="failed to get container status \"befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe\": rpc error: code = NotFound desc = could not find container \"befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe\": container with ID starting with befae664fd6230f75051108372cfa3b9a1c6813a4cd4c6ba9d2ad2fc80f572fe not found: ID does not exist"
Oct 30 16:39:14.200308 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.200286    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"]
Oct 30 16:39:14.203424 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.203405    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-cmb2b"]
Oct 30 16:39:14.236428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.236392    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"]
Oct 30 16:39:14.243223 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.243196    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-mhrh2"]
Oct 30 16:39:14.246972 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.246944    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-socket\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247111 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.246990    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7af01b9f-4689-4c66-9965-c756e8dc00b8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af01b9f-4689-4c66-9965-c756e8dc00b8-istiod-ca-cert\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247111 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247020    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-envoy\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247219 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247127    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-credential-socket\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247223    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-kube-api-access-2kpd6\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-kube-api-access-2kpd6\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247283 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247264    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-token\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-token\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247293    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-certs\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247629 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247309    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-socket" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.247720 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247528    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-certs" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.247720 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247557    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7af01b9f-4689-4c66-9965-c756e8dc00b8-istiod-ca-cert" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:14.247720 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247671    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-data\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247762    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-credential-socket" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.247901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247792    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-podinfo\") pod \"7af01b9f-4689-4c66-9965-c756e8dc00b8\" (UID: \"7af01b9f-4689-4c66-9965-c756e8dc00b8\") "
Oct 30 16:39:14.247987 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.247906    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-data" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.248771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.248745    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.248877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.248776    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af01b9f-4689-4c66-9965-c756e8dc00b8-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.248877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.248791    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.248877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.248805    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.248877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.248818    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.249647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.249626    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-kube-api-access-2kpd6" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "kube-api-access-2kpd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:14.249845 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.249823    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-token" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:14.249901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.249842    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-podinfo" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:14.249901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.249893    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-envoy" pod "7af01b9f-4689-4c66-9965-c756e8dc00b8" (UID: "7af01b9f-4689-4c66-9965-c756e8dc00b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.351001 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.350918    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.351001 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.350957    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.351001 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.350971    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kpd6\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-kube-api-access-2kpd6\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.351001 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.350985    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af01b9f-4689-4c66-9965-c756e8dc00b8-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.473088 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.473048    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"]
Oct 30 16:39:14.483417 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:14.483377    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-tf8wq"]
Oct 30 16:39:15.093032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:15.092993    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" path="/var/lib/kubelet/pods/065cafa3-3491-45f6-97d6-c63d753d52d6/volumes"
Oct 30 16:39:15.094806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:15.093811    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" path="/var/lib/kubelet/pods/29cff232-c732-440a-bdc1-c18faddb48d9/volumes"
Oct 30 16:39:15.094806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:15.094403    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" path="/var/lib/kubelet/pods/7af01b9f-4689-4c66-9965-c756e8dc00b8/volumes"
Oct 30 16:39:15.101657 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:15.101630    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:16.546909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:16.546878    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:16.842252 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:16.842062    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:17.285603 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.285560    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main" containerID="cri-o://3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523" gracePeriod=44
Oct 30 16:39:17.577916 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.577891    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:39:17.698774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.698740    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tmp-dir\") pod \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") "
Oct 30 16:39:17.698923 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.698785    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tls-certs\") pod \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") "
Oct 30 16:39:17.698923 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.698819    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-dshm\") pod \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") "
Oct 30 16:39:17.699046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.698922    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-home\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-home\") pod \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") "
Oct 30 16:39:17.699046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.699014    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tmp-dir" pod "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" (UID: "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:17.699183 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.699139    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-kube-api-access-pvckj\" (UniqueName: \"kubernetes.io/projected/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-kube-api-access-pvckj\") pod \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") "
Oct 30 16:39:17.699253 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.699187    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-model-cache\") pod \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\" (UID: \"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378\") "
Oct 30 16:39:17.699253 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.699207    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-home" pod "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" (UID: "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:17.699535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.699511    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-model-cache" pod "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" (UID: "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:17.699767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.699746    5101 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tmp-dir\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:17.699767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.699768    5101 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-home\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:17.699916 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.699781    5101 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-model-cache\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:17.701045 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.701015    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-dshm" pod "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" (UID: "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:17.701248 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.701228    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tls-certs" pod "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" (UID: "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:17.701312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.701291    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-kube-api-access-pvckj" pod "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" (UID: "9ce15dbf-0e81-4cb3-9121-84fc4cdf4378"). InnerVolumeSpecName "kube-api-access-pvckj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:17.801428 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.801326    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvckj\" (UniqueName: \"kubernetes.io/projected/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-kube-api-access-pvckj\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:17.801584 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.801499    5101 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-tls-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:17.801761 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:17.801745    5101 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378-dshm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:18.154836 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.154799    5101 generic.go:356] "Generic (PLEG): container finished" podID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerID="3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523" exitCode=0
Oct 30 16:39:18.155014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.154867    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"
Oct 30 16:39:18.155014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.154890    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" event={"ID":"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378","Type":"ContainerDied","Data":"3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523"}
Oct 30 16:39:18.155014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.154938    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd" event={"ID":"9ce15dbf-0e81-4cb3-9121-84fc4cdf4378","Type":"ContainerDied","Data":"fed22a6fd0de23c7a0e7c814d732b846832d9623fa74d8598f1f748bc0db5ef0"}
Oct 30 16:39:18.155014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.154957    5101 scope.go:122] "RemoveContainer" containerID="3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523"
Oct 30 16:39:18.165531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.165507    5101 scope.go:122] "RemoveContainer" containerID="3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523"
Oct 30 16:39:18.165885 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:18.165865    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523\": container with ID starting with 3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523 not found: ID does not exist" containerID="3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523"
Oct 30 16:39:18.165968 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.165894    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523"} err="failed to get container status \"3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523\": rpc error: code = NotFound desc = could not find container \"3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523\": container with ID starting with 3b5d2b588a976bb3e51c6e47e8c17059c253cf256da8b1a6aa2f786715f3f523 not found: ID does not exist"
Oct 30 16:39:18.210748 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.210710    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"]
Oct 30 16:39:18.222211 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.222182    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-w4-b8ab9f-kserve-57bbfdf7f-cnxnd"]
Oct 30 16:39:18.603457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:18.603325    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:19.074776 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.074743    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" path="/var/lib/kubelet/pods/9ce15dbf-0e81-4cb3-9121-84fc4cdf4378/volumes"
Oct 30 16:39:19.403467 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.403430    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"]
Oct 30 16:39:19.404023 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404007    5101 cpu_manager.go:414] "containerMap: removing container" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy"
Oct 30 16:39:19.404106 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404024    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy"
Oct 30 16:39:19.404106 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404088    5101 cpu_manager.go:414] "containerMap: removing container" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy"
Oct 30 16:39:19.404106 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404098    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy"
Oct 30 16:39:19.404221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404111    5101 cpu_manager.go:414] "containerMap: removing container" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy"
Oct 30 16:39:19.404221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404119    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy"
Oct 30 16:39:19.404221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404133    5101 cpu_manager.go:414] "containerMap: removing container" podUID="7c0406f0-7956-48bb-8a87-135ac4487eba" containerName="revoke-keys"
Oct 30 16:39:19.404221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404140    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c0406f0-7956-48bb-8a87-135ac4487eba" containerName="revoke-keys"
Oct 30 16:39:19.404221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404158    5101 cpu_manager.go:414] "containerMap: removing container" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main"
Oct 30 16:39:19.404221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404164    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main"
Oct 30 16:39:19.404449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404352    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="7af01b9f-4689-4c66-9965-c756e8dc00b8" containerName="istio-proxy"
Oct 30 16:39:19.404449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404364    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="29cff232-c732-440a-bdc1-c18faddb48d9" containerName="istio-proxy"
Oct 30 16:39:19.404449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404373    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c0406f0-7956-48bb-8a87-135ac4487eba" containerName="revoke-keys"
Oct 30 16:39:19.404449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404380    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ce15dbf-0e81-4cb3-9121-84fc4cdf4378" containerName="main"
Oct 30 16:39:19.404449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404387    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy"
Oct 30 16:39:19.404449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.404396    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy"
Oct 30 16:39:19.409824 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.409799    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.420730    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.420779    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.420817    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0cc338c-3c25-4160-aeda-6521e261f4c6-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.420927    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.420958    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.421043    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.421071    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5mb9\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-kube-api-access-x5mb9\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.421103    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.424526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.421128    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.445431 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.445400    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"]
Oct 30 16:39:19.522330 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522302    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.522564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522542    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.522656 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522642    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.522714 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522673    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5mb9\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-kube-api-access-x5mb9\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.522775 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522711    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.522775 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522736    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.522881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522811    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.522881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522842    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.522977 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.522889    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0cc338c-3c25-4160-aeda-6521e261f4c6-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.523786 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.523758    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0cc338c-3c25-4160-aeda-6521e261f4c6-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.525673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.524189    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.525794 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.524562    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.525872 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.524724    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.525965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.524883    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.527914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.527848    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.528405 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.528382    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.548569 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.548539    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:19.551965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.551947    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.554709 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.554692    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5mb9\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-kube-api-access-x5mb9\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:19.725392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.725266    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:19.732244 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:19.732214    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:20.112565 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:20.105174    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"]
Oct 30 16:39:20.123678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:20.122708    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:39:20.123678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:20.122806    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:39:20.123678 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:20.122868    5101 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 16:39:20.183907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:20.183812    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" event={"ID":"a0cc338c-3c25-4160-aeda-6521e261f4c6","Type":"ContainerStarted","Data":"d9e86f0c62df2c3b97ab38a0b35f93191b3b59597c2f0d30bd350ed611bf0322"}
Oct 30 16:39:20.308268 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:20.308232    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:39:20.921129 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:20.921030    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:21.234422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:21.234188    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" event={"ID":"a0cc338c-3c25-4160-aeda-6521e261f4c6","Type":"ContainerStarted","Data":"f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c"}
Oct 30 16:39:21.357389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:21.357294    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podStartSLOduration=2.357273769 podStartE2EDuration="2.357273769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:39:21.337978565 +0000 UTC m=+1180.391256200" watchObservedRunningTime="2026-10-30 16:39:21.357273769 +0000 UTC m=+1180.410551381"
Oct 30 16:39:21.696364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:21.695300    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:21.738395 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:21.734310    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:21.738395 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:21.734464    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:21.738395 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:21.734510    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:21.840366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:21.837389    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"]
Oct 30 16:39:22.054422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.048432    5101 cpu_manager.go:414] "containerMap: removing container" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy"
Oct 30 16:39:22.054422 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.048478    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="065cafa3-3491-45f6-97d6-c63d753d52d6" containerName="istio-proxy"
Oct 30 16:39:22.499853 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.499808    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:22.565366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.505445    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:22.654221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.566133    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:39:22.658561 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.566166    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:39:22.658730 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.598520    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"]
Oct 30 16:39:22.682504 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.654171    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:22.876434 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.823827    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rwdm\" (UniqueName: \"kubernetes.io/projected/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-kube-api-access-8rwdm\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:22.904368 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.840381    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:22.904634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.904600    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:22.991364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.987281    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:22.991364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.987409    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:22.991364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.987552    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rwdm\" (UniqueName: \"kubernetes.io/projected/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-kube-api-access-8rwdm\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:22.991364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:22.989580    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:23.021163 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:23.021115    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:23.053136 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:23.052681    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rwdm\" (UniqueName: \"kubernetes.io/projected/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-kube-api-access-8rwdm\") pod \"maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:23.172864 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:23.172833    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:23.789366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:23.752521    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:23.789366 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:23.752599    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:24.040013 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:24.039907    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs" podUID="07d3bc60-31d5-4cd8-9ce3-f8d78c380759" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:39:24.040805 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:24.040778    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd" podUID="ded8b30e-d48b-46cf-8398-8f9b80f09ebc" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:39:24.740192 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:24.740161    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:24.740975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:24.740935    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:24.784363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:24.780514    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"]
Oct 30 16:39:25.008811 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.008690    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:25.011365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.011318    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k" event={"ID":"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a","Type":"ContainerStarted","Data":"5d5612ea7246b45ac550e4d9791da9414107d528aa9017a86fd342de0e2474d1"}
Oct 30 16:39:25.421981 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.421943    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"]
Oct 30 16:39:25.422218 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.422192    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt" podUID="6e722e81-9a86-4329-ba68-3f409245dd65" containerName="maas-api" containerID="cri-o://a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640" gracePeriod=30
Oct 30 16:39:25.537868 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.537184    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:25.693191 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.693162    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:25.732670 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.732640    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:25.732827 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.732702    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:25.831725 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.831623    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"]
Oct 30 16:39:25.835325 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.835294    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7610c-jzx6k"]
Oct 30 16:39:25.875496 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:25.875450    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:26.025000 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.024962    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k" event={"ID":"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a","Type":"ContainerStarted","Data":"0810865ca3a181f98688ee9c2be8d6e4abbb962e3f0243648d7e9b51a08fe36a"}
Oct 30 16:39:26.056716 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.056673    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt" podUID="6e722e81-9a86-4329-ba68-3f409245dd65" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.63:8443/health\": dial tcp 10.132.0.63:8443: connect: connection refused"
Oct 30 16:39:26.317310 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.317275    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:26.497523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.497444    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:26.511484 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.511436    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k" podStartSLOduration=5.511420639 podStartE2EDuration="5.511420639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:39:26.08271157 +0000 UTC m=+1185.135989184" watchObservedRunningTime="2026-10-30 16:39:26.511420639 +0000 UTC m=+1185.564698285"
Oct 30 16:39:26.513168 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.513142    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"]
Oct 30 16:39:26.670684 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.670600    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:26.732910 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.732874    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:26.733074 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.732939    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:26.831038 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.831011    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:39:26.841415 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.841380    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:26.927068 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.927018    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e722e81-9a86-4329-ba68-3f409245dd65-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e722e81-9a86-4329-ba68-3f409245dd65-openshift-service-ca\") pod \"6e722e81-9a86-4329-ba68-3f409245dd65\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") "
Oct 30 16:39:26.927309 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.927103    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-metrics-certs\") pod \"6e722e81-9a86-4329-ba68-3f409245dd65\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") "
Oct 30 16:39:26.927309 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.927227    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-maas-api-tls\") pod \"6e722e81-9a86-4329-ba68-3f409245dd65\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") "
Oct 30 16:39:26.927526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.927410    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e722e81-9a86-4329-ba68-3f409245dd65-kube-api-access-h7ggw\" (UniqueName: \"kubernetes.io/projected/6e722e81-9a86-4329-ba68-3f409245dd65-kube-api-access-h7ggw\") pod \"6e722e81-9a86-4329-ba68-3f409245dd65\" (UID: \"6e722e81-9a86-4329-ba68-3f409245dd65\") "
Oct 30 16:39:26.927526 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.927506    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e722e81-9a86-4329-ba68-3f409245dd65-openshift-service-ca" pod "6e722e81-9a86-4329-ba68-3f409245dd65" (UID: "6e722e81-9a86-4329-ba68-3f409245dd65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:26.928062 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.928035    5101 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e722e81-9a86-4329-ba68-3f409245dd65-openshift-service-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:26.930505 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.930479    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e722e81-9a86-4329-ba68-3f409245dd65-kube-api-access-h7ggw" pod "6e722e81-9a86-4329-ba68-3f409245dd65" (UID: "6e722e81-9a86-4329-ba68-3f409245dd65"). InnerVolumeSpecName "kube-api-access-h7ggw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:26.935807 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.935782    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-metrics-certs" pod "6e722e81-9a86-4329-ba68-3f409245dd65" (UID: "6e722e81-9a86-4329-ba68-3f409245dd65"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:26.940018 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:26.939983    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-maas-api-tls" pod "6e722e81-9a86-4329-ba68-3f409245dd65" (UID: "6e722e81-9a86-4329-ba68-3f409245dd65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:27.028883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.028853    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-maas-api-tls\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:27.028883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.028881    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7ggw\" (UniqueName: \"kubernetes.io/projected/6e722e81-9a86-4329-ba68-3f409245dd65-kube-api-access-h7ggw\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:27.028883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.028892    5101 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e722e81-9a86-4329-ba68-3f409245dd65-metrics-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:27.033700 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.033673    5101 generic.go:356] "Generic (PLEG): container finished" podID="6e722e81-9a86-4329-ba68-3f409245dd65" containerID="a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640" exitCode=0
Oct 30 16:39:27.033835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.033723    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"
Oct 30 16:39:27.033835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.033757    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt" event={"ID":"6e722e81-9a86-4329-ba68-3f409245dd65","Type":"ContainerDied","Data":"a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640"}
Oct 30 16:39:27.033935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.033845    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt" event={"ID":"6e722e81-9a86-4329-ba68-3f409245dd65","Type":"ContainerDied","Data":"12c762f87abc414944f72b5c862dc5ca345ed8cb3dfb6ad3f071160d669d5ade"}
Oct 30 16:39:27.033935 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.033873    5101 scope.go:122] "RemoveContainer" containerID="a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640"
Oct 30 16:39:27.035533 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.035507    5101 generic.go:356] "Generic (PLEG): container finished" podID="1f7431cf-efd4-4a99-a5d9-a73767c0cf0a" containerID="0810865ca3a181f98688ee9c2be8d6e4abbb962e3f0243648d7e9b51a08fe36a" exitCode=0
Oct 30 16:39:27.035644 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.035627    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k" event={"ID":"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a","Type":"ContainerDied","Data":"0810865ca3a181f98688ee9c2be8d6e4abbb962e3f0243648d7e9b51a08fe36a"}
Oct 30 16:39:27.070564 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.070541    5101 scope.go:122] "RemoveContainer" containerID="a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640"
Oct 30 16:39:27.070918 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:27.070895    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640\": container with ID starting with a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640 not found: ID does not exist" containerID="a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640"
Oct 30 16:39:27.071021 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.070925    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640"} err="failed to get container status \"a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640\": rpc error: code = NotFound desc = could not find container \"a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640\": container with ID starting with a876ce3fa3d77a0968bcb246840a53a2f70f47fba8987c7e9c888700afac5640 not found: ID does not exist"
Oct 30 16:39:27.080633 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.080597    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f39ffcd-2842-4b7d-b763-24343d59a474" path="/var/lib/kubelet/pods/6f39ffcd-2842-4b7d-b763-24343d59a474/volumes"
Oct 30 16:39:27.138367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.138321    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:27.139545 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.139523    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"]
Oct 30 16:39:27.167375 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.165645    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b8ab9f-6b4f47648b-5wgpt"]
Oct 30 16:39:27.733568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.733532    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:27.733757 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:27.733598    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:28.292515 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.292490    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:28.385474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.384283    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-openshift-ca\") pod \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") "
Oct 30 16:39:28.385474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.384528    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-xks-ca\") pod \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") "
Oct 30 16:39:28.385474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.384664    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-kube-api-access-8rwdm\" (UniqueName: \"kubernetes.io/projected/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-kube-api-access-8rwdm\") pod \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\" (UID: \"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a\") "
Oct 30 16:39:28.386881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.386844    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-openshift-ca" pod "1f7431cf-efd4-4a99-a5d9-a73767c0cf0a" (UID: "1f7431cf-efd4-4a99-a5d9-a73767c0cf0a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:28.391126 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.391097    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-xks-ca" pod "1f7431cf-efd4-4a99-a5d9-a73767c0cf0a" (UID: "1f7431cf-efd4-4a99-a5d9-a73767c0cf0a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:28.392506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.392479    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-kube-api-access-8rwdm" pod "1f7431cf-efd4-4a99-a5d9-a73767c0cf0a" (UID: "1f7431cf-efd4-4a99-a5d9-a73767c0cf0a"). InnerVolumeSpecName "kube-api-access-8rwdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:28.486866 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.486829    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:28.486866 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.486864    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rwdm\" (UniqueName: \"kubernetes.io/projected/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-kube-api-access-8rwdm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:28.487080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.486878    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:28.732999 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.732965    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:28.733216 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.733021    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:28.801968 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:28.801928    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:29.077379 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:29.077279    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e722e81-9a86-4329-ba68-3f409245dd65" path="/var/lib/kubelet/pods/6e722e81-9a86-4329-ba68-3f409245dd65/volumes"
Oct 30 16:39:29.081236 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:29.081206    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"
Oct 30 16:39:29.081236 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:29.081222    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k" event={"ID":"1f7431cf-efd4-4a99-a5d9-a73767c0cf0a","Type":"ContainerDied","Data":"5d5612ea7246b45ac550e4d9791da9414107d528aa9017a86fd342de0e2474d1"}
Oct 30 16:39:29.081466 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:29.081265    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d5612ea7246b45ac550e4d9791da9414107d528aa9017a86fd342de0e2474d1"
Oct 30 16:39:29.733626 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:29.733584    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 16:39:29.734118 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:29.733664    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 16:39:29.904819 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:29.904779    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:30.082522 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:30.082423    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:30.741486 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:30.741447    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:31.346551 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.346078    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:39:31.442235 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.442202    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-kube-api-access-z88qt\" (UniqueName: \"kubernetes.io/projected/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-kube-api-access-z88qt\") pod \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\" (UID: \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\") "
Oct 30 16:39:31.442448 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.442259    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-plugins-config-volume\") pod \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\" (UID: \"07d3bc60-31d5-4cd8-9ce3-f8d78c380759\") "
Oct 30 16:39:31.467454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.443173    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-plugins-config-volume" pod "07d3bc60-31d5-4cd8-9ce3-f8d78c380759" (UID: "07d3bc60-31d5-4cd8-9ce3-f8d78c380759"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:31.467454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.447102    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:39:31.467454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.447634    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-kube-api-access-z88qt" pod "07d3bc60-31d5-4cd8-9ce3-f8d78c380759" (UID: "07d3bc60-31d5-4cd8-9ce3-f8d78c380759"). InnerVolumeSpecName "kube-api-access-z88qt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:31.472882 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.469283    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:31.544292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.544262    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-kube-api-access-tglcw\" (UniqueName: \"kubernetes.io/projected/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-kube-api-access-tglcw\") pod \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\" (UID: \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\") "
Oct 30 16:39:31.544518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.544441    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-plugins-config-volume\") pod \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\" (UID: \"ded8b30e-d48b-46cf-8398-8f9b80f09ebc\") "
Oct 30 16:39:31.544991 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.544967    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z88qt\" (UniqueName: \"kubernetes.io/projected/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-kube-api-access-z88qt\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:31.545119 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.544993    5101 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d3bc60-31d5-4cd8-9ce3-f8d78c380759-plugins-config-volume\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:31.545389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.545358    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-plugins-config-volume" pod "ded8b30e-d48b-46cf-8398-8f9b80f09ebc" (UID: "ded8b30e-d48b-46cf-8398-8f9b80f09ebc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:31.547443 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.547420    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-kube-api-access-tglcw" pod "ded8b30e-d48b-46cf-8398-8f9b80f09ebc" (UID: "ded8b30e-d48b-46cf-8398-8f9b80f09ebc"). InnerVolumeSpecName "kube-api-access-tglcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:31.646636 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.646604    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tglcw\" (UniqueName: \"kubernetes.io/projected/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-kube-api-access-tglcw\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:31.646636 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.646636    5101 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded8b30e-d48b-46cf-8398-8f9b80f09ebc-plugins-config-volume\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:31.775536 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.775494    5101 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:39:31.776060 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:31.775581    5101 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:32.114762 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.114724    5101 generic.go:356] "Generic (PLEG): container finished" podID="ded8b30e-d48b-46cf-8398-8f9b80f09ebc" containerID="f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9" exitCode=0
Oct 30 16:39:32.115139 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.115112    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd" event={"ID":"ded8b30e-d48b-46cf-8398-8f9b80f09ebc","Type":"ContainerDied","Data":"f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9"}
Oct 30 16:39:32.115324 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.115307    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd" event={"ID":"ded8b30e-d48b-46cf-8398-8f9b80f09ebc","Type":"ContainerDied","Data":"6dab259b8aa5b24144e459b456e0c00f04b78b4fabf599053d29b3bd6f9a7f26"}
Oct 30 16:39:32.115463 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.115450    5101 scope.go:122] "RemoveContainer" containerID="f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9"
Oct 30 16:39:32.115676 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.115662    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"
Oct 30 16:39:32.118170 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.118146    5101 generic.go:356] "Generic (PLEG): container finished" podID="07d3bc60-31d5-4cd8-9ce3-f8d78c380759" containerID="5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809" exitCode=0
Oct 30 16:39:32.118273 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.118197    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"
Oct 30 16:39:32.118399 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.118195    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs" event={"ID":"07d3bc60-31d5-4cd8-9ce3-f8d78c380759","Type":"ContainerDied","Data":"5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809"}
Oct 30 16:39:32.118474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.118427    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs" event={"ID":"07d3bc60-31d5-4cd8-9ce3-f8d78c380759","Type":"ContainerDied","Data":"d15cedf257abc327b37c739561dbc840f6c749e70785ab26f60ff8d5410b8141"}
Oct 30 16:39:32.128983 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.128961    5101 scope.go:122] "RemoveContainer" containerID="f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9"
Oct 30 16:39:32.129333 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:32.129278    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9\": container with ID starting with f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9 not found: ID does not exist" containerID="f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9"
Oct 30 16:39:32.129333 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.129315    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9"} err="failed to get container status \"f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9\": rpc error: code = NotFound desc = could not find container \"f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9\": container with ID starting with f83aac0b5323e598d892aa6606301e7ba5a90ada4e3a29e726b84c0024094ab9 not found: ID does not exist"
Oct 30 16:39:32.129484 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.129352    5101 scope.go:122] "RemoveContainer" containerID="5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809"
Oct 30 16:39:32.141599 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.141578    5101 scope.go:122] "RemoveContainer" containerID="5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809"
Oct 30 16:39:32.141926 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:32.141895    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809\": container with ID starting with 5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809 not found: ID does not exist" containerID="5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809"
Oct 30 16:39:32.142037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.141925    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809"} err="failed to get container status \"5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809\": rpc error: code = NotFound desc = could not find container \"5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809\": container with ID starting with 5efe6f7fe092b9aae70c0ee53865fcb63cfdd3ade49fa3bca2e78a884eade809 not found: ID does not exist"
Oct 30 16:39:32.183563 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.183521    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"]
Oct 30 16:39:32.198264 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.198229    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b8ab9f-7fdcb7f967-ghhbd"]
Oct 30 16:39:32.236050 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.236019    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"]
Oct 30 16:39:32.246484 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.246449    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-b8ab9f-6495c5b567-m97hs"]
Oct 30 16:39:32.332994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.332911    5101 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:32.333300 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.333276    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:32.334312 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.334293    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:32.611778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.611689    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:32.788587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:32.788503    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:33.075050 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:33.075015    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07d3bc60-31d5-4cd8-9ce3-f8d78c380759" path="/var/lib/kubelet/pods/07d3bc60-31d5-4cd8-9ce3-f8d78c380759/volumes"
Oct 30 16:39:33.075503 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:33.075487    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ded8b30e-d48b-46cf-8398-8f9b80f09ebc" path="/var/lib/kubelet/pods/ded8b30e-d48b-46cf-8398-8f9b80f09ebc/volumes"
Oct 30 16:39:33.455616 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:33.455579    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:34.661903 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:34.661871    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:34.812809 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:34.812779    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:34.952261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:34.952171    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"]
Oct 30 16:39:34.952471 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:34.952425    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy" containerID="cri-o://5dc244d9b7703d53d734f6ad77b82d9e047aba026ad5cf1e2060a68338f52987" gracePeriod=30
Oct 30 16:39:34.975731 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:34.975679    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:34.976628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:34.976590    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"]
Oct 30 16:39:34.977040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:34.977000    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy" containerID="cri-o://64bd4e9088efc4893e64558046b4019e79629500bb9a5093dbfbda8317e5c530" gracePeriod=30
Oct 30 16:39:34.981055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:34.981031    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"]
Oct 30 16:39:35.134427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.134394    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"]
Oct 30 16:39:35.134659 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.134632    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy" containerID="cri-o://71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2" gracePeriod=30
Oct 30 16:39:35.144275 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.144243    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"]
Oct 30 16:39:35.144457 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.144318    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"]
Oct 30 16:39:35.144535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.144509    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy" containerID="cri-o://69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3" gracePeriod=30
Oct 30 16:39:35.144755 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.144731    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy" containerID="cri-o://a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54" gracePeriod=30
Oct 30 16:39:35.151773 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.151746    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"]
Oct 30 16:39:35.151964 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.151942    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy" containerID="cri-o://cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a" gracePeriod=30
Oct 30 16:39:35.154743 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.154710    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy" containerID="cri-o://f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c" gracePeriod=30
Oct 30 16:39:35.155404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.155248    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:35.324858 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:35.324779    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:37.445655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:37.445613    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:37.622162 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:37.622129    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:39.309127 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:39.309094    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:39.455634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:39.455601    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:40.214840 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.214806    5101 generic.go:356] "Generic (PLEG): container finished" podID="588f354f-5e74-4a4e-a482-285991ec20a6" containerID="5dc244d9b7703d53d734f6ad77b82d9e047aba026ad5cf1e2060a68338f52987" exitCode=0
Oct 30 16:39:40.214992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.214970    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" event={"ID":"588f354f-5e74-4a4e-a482-285991ec20a6","Type":"ContainerDied","Data":"5dc244d9b7703d53d734f6ad77b82d9e047aba026ad5cf1e2060a68338f52987"}
Oct 30 16:39:40.217123 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.217095    5101 generic.go:356] "Generic (PLEG): container finished" podID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerID="64bd4e9088efc4893e64558046b4019e79629500bb9a5093dbfbda8317e5c530" exitCode=0
Oct 30 16:39:40.217226 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.217159    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" event={"ID":"f5eca49e-b247-415e-9f7f-c60a579d3fa5","Type":"ContainerDied","Data":"64bd4e9088efc4893e64558046b4019e79629500bb9a5093dbfbda8317e5c530"}
Oct 30 16:39:40.477636 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.476429    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:39:40.479900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.479872    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:39:40.489058 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.489034    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:39:40.550461 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.550373    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:39:40.561974 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.561949    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:39:40.567575 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.567554    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:39:40.571158 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.571141    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:40.598296 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598268    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-socket\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.598427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598329    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/588f354f-5e74-4a4e-a482-285991ec20a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/588f354f-5e74-4a4e-a482-285991ec20a6-istiod-ca-cert\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.598427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598404    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-podinfo\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.598535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598438    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-data\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.598535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598466    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-socket" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.598535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598500    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istiod-ca-cert\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.598535 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598523    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-socket\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.598733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598553    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-envoy\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.598733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598583    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb69f0da-4c6f-4cec-b805-52e1f730140d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb69f0da-4c6f-4cec-b805-52e1f730140d-istiod-ca-cert\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.598733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598646    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-socket\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.598733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598674    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-kube-api-access-skn5t\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-kube-api-access-skn5t\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.598733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598712    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-envoy\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.598979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598751    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-credential-socket\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.598979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598780    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-certs\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.598979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598818    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-certs\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.598979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598855    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-credential-socket\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.598979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598882    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-credential-socket\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.598979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598912    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-kube-api-access-gcf2b\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-kube-api-access-gcf2b\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.598979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598945    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-podinfo\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.598979 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598973    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af98f09a-061a-4c99-b351-30d4c047ea5e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af98f09a-061a-4c99-b351-30d4c047ea5e-istiod-ca-cert\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598998    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-kube-api-access-47dsk\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-kube-api-access-47dsk\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599044    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-certs\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599088    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-istio-token\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-istio-token\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599124    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-envoy\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599153    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-data\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599181    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-socket\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599214    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-credential-socket\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599243    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-data\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599306    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-certs\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599335    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e727bca-9076-45eb-85d1-578c713eee37-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e727bca-9076-45eb-85d1-578c713eee37-istiod-ca-cert\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.599374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599378    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-certs\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599409    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istiod-ca-cert\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599443    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-kube-api-access-7r5td\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-kube-api-access-7r5td\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599490    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3e727bca-9076-45eb-85d1-578c713eee37-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e727bca-9076-45eb-85d1-578c713eee37-istio-podinfo\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599563    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-data\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599594    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-credential-socket\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599648    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-socket\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598777    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/588f354f-5e74-4a4e-a482-285991ec20a6-istiod-ca-cert" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598844    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istiod-ca-cert" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.598858    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-socket" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599103    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-certs" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599288    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-credential-socket" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599295    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb69f0da-4c6f-4cec-b805-52e1f730140d-istiod-ca-cert" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599649    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af98f09a-061a-4c99-b351-30d4c047ea5e-istiod-ca-cert" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.599914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599820    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-socket" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599963    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-certs" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600000    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0cc338c-3c25-4160-aeda-6521e261f4c6-istiod-ca-cert" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600230    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-data" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600424    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-credential-socket" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.599674    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0cc338c-3c25-4160-aeda-6521e261f4c6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0cc338c-3c25-4160-aeda-6521e261f4c6-istiod-ca-cert\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600494    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-credential-socket\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600531    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-envoy\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600570    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-data\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600607    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-envoy\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.600655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600656    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-credential-socket\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600691    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-socket\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600728    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-token\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-token\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600766    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/588f354f-5e74-4a4e-a482-285991ec20a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/588f354f-5e74-4a4e-a482-285991ec20a6-istio-podinfo\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600797    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-podinfo\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600827    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-podinfo\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600865    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-kube-api-access-x5mb9\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-kube-api-access-x5mb9\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600914    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-kube-api-access-c77rj\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-kube-api-access-c77rj\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.600942    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-podinfo\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601004    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-socket\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601037    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-kube-api-access-cj2sm\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-kube-api-access-cj2sm\") pod \"eb69f0da-4c6f-4cec-b805-52e1f730140d\" (UID: \"eb69f0da-4c6f-4cec-b805-52e1f730140d\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601080    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-token\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-token\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601113    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-certs\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601113    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-kube-api-access-skn5t" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "kube-api-access-skn5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601138    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-podinfo" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.601157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601143    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-token\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-token\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601202    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-istio-token\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-istio-token\") pod \"588f354f-5e74-4a4e-a482-285991ec20a6\" (UID: \"588f354f-5e74-4a4e-a482-285991ec20a6\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601252    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-envoy\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601258    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-envoy" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601285    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-data\") pod \"af98f09a-061a-4c99-b351-30d4c047ea5e\" (UID: \"af98f09a-061a-4c99-b351-30d4c047ea5e\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601381    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-envoy\") pod \"a0cc338c-3c25-4160-aeda-6521e261f4c6\" (UID: \"a0cc338c-3c25-4160-aeda-6521e261f4c6\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601431    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-certs" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601434    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-token\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-token\") pod \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\" (UID: \"f5eca49e-b247-415e-9f7f-c60a579d3fa5\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601484    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-certs\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601531    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-data\") pod \"3e727bca-9076-45eb-85d1-578c713eee37\" (UID: \"3e727bca-9076-45eb-85d1-578c713eee37\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601533    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-envoy" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601610    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-token\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-token\") pod \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\" (UID: \"b3b6dbca-b179-4b3c-9012-90bb31fc71da\") "
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601732    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-data" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.601919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.601903    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-certs" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602365    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-kube-api-access-47dsk" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "kube-api-access-47dsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602422    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602446    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0cc338c-3c25-4160-aeda-6521e261f4c6-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602460    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602474    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602488    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/588f354f-5e74-4a4e-a482-285991ec20a6-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602502    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602515    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602527    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.602568 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602571    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602585    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602599    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb69f0da-4c6f-4cec-b805-52e1f730140d-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602613    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602627    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skn5t\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-kube-api-access-skn5t\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602641    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602654    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602668    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602681    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602690    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e727bca-9076-45eb-85d1-578c713eee37-istiod-ca-cert" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602693    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602720    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af98f09a-061a-4c99-b351-30d4c047ea5e-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602731    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.603086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.602896    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-certs" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.603736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.603174    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istiod-ca-cert" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.603736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.603326    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-istio-token" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.603736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.603381    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-kube-api-access-gcf2b" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "kube-api-access-gcf2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.603736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.603594    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-token" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.603736 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.603596    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-credential-socket" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.603994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.603768    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-data" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.604767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.604324    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-token" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.604767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.604579    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-data" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.604900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.604800    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-credential-socket" pod "b3b6dbca-b179-4b3c-9012-90bb31fc71da" (UID: "b3b6dbca-b179-4b3c-9012-90bb31fc71da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.604975 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.604915    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-istio-token" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.605097 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.604989    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-socket" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.605166 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.605088    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-podinfo" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.605277 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.605210    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-credential-socket" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.605321 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.605281    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-token" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.605476 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.605448    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-data" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.605543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.605473    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-data" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.605875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.605660    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-socket" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.605875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.605762    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-kube-api-access-7r5td" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "kube-api-access-7r5td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.606008 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.605951    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e727bca-9076-45eb-85d1-578c713eee37-istio-podinfo" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.606073 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.606001    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-podinfo" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.606168 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.606147    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-certs" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.606228 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.606183    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-credential-socket" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.606379 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.606362    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-socket" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.606618 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.606598    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-socket" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.607121 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.607099    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-envoy" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.607280 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.607257    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-envoy" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.607515 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.607397    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-data" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.607623 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.607600    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-podinfo" pod "f5eca49e-b247-415e-9f7f-c60a579d3fa5" (UID: "f5eca49e-b247-415e-9f7f-c60a579d3fa5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.607810 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.607785    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-certs" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.607885 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.607816    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-envoy" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.608423 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.608191    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-credential-socket" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.610861 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.610837    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/588f354f-5e74-4a4e-a482-285991ec20a6-istio-podinfo" pod "588f354f-5e74-4a4e-a482-285991ec20a6" (UID: "588f354f-5e74-4a4e-a482-285991ec20a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.612847 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.612588    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-token" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.616418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.614810    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-envoy" pod "3e727bca-9076-45eb-85d1-578c713eee37" (UID: "3e727bca-9076-45eb-85d1-578c713eee37"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.616418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.614963    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-kube-api-access-x5mb9" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "kube-api-access-x5mb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.616418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.615298    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-kube-api-access-cj2sm" pod "eb69f0da-4c6f-4cec-b805-52e1f730140d" (UID: "eb69f0da-4c6f-4cec-b805-52e1f730140d"). InnerVolumeSpecName "kube-api-access-cj2sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.616418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.616234    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-envoy" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.616655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.616628    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-token" pod "a0cc338c-3c25-4160-aeda-6521e261f4c6" (UID: "a0cc338c-3c25-4160-aeda-6521e261f4c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.616855 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.616832    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-podinfo" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.616945 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.616885    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-kube-api-access-c77rj" pod "af98f09a-061a-4c99-b351-30d4c047ea5e" (UID: "af98f09a-061a-4c99-b351-30d4c047ea5e"). InnerVolumeSpecName "kube-api-access-c77rj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.704330 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704293    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704330    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704377    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704391    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704405    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704419    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704431    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e727bca-9076-45eb-85d1-578c713eee37-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704444    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704456    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704468    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r5td\" (UniqueName: \"kubernetes.io/projected/3e727bca-9076-45eb-85d1-578c713eee37-kube-api-access-7r5td\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704481    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e727bca-9076-45eb-85d1-578c713eee37-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704499 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704494    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704505    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b6dbca-b179-4b3c-9012-90bb31fc71da-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704518    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704533    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704545    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704559    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704572    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704584    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb69f0da-4c6f-4cec-b805-52e1f730140d-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704596    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704610    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704624    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/588f354f-5e74-4a4e-a482-285991ec20a6-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704635    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704649    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704661    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5mb9\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-kube-api-access-x5mb9\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704674    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c77rj\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-kube-api-access-c77rj\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704688    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704699    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704712    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj2sm\" (UniqueName: \"kubernetes.io/projected/eb69f0da-4c6f-4cec-b805-52e1f730140d-kube-api-access-cj2sm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704724    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704737    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/588f354f-5e74-4a4e-a482-285991ec20a6-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704748    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704760    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704771    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704783    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af98f09a-061a-4c99-b351-30d4c047ea5e-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704795    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0cc338c-3c25-4160-aeda-6521e261f4c6-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.704806 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704807    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5eca49e-b247-415e-9f7f-c60a579d3fa5-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.705688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704819    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e727bca-9076-45eb-85d1-578c713eee37-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.705688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704831    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.705688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704844    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5eca49e-b247-415e-9f7f-c60a579d3fa5-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.705688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704856    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcf2b\" (UniqueName: \"kubernetes.io/projected/b3b6dbca-b179-4b3c-9012-90bb31fc71da-kube-api-access-gcf2b\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.705688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704870    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb69f0da-4c6f-4cec-b805-52e1f730140d-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.705688 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:40.704882    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47dsk\" (UniqueName: \"kubernetes.io/projected/588f354f-5e74-4a4e-a482-285991ec20a6-kube-api-access-47dsk\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:41.149742 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.149711    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:41.225190 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.225153    5101 generic.go:356] "Generic (PLEG): container finished" podID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerID="cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a" exitCode=0
Oct 30 16:39:41.225376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.225189    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" event={"ID":"af98f09a-061a-4c99-b351-30d4c047ea5e","Type":"ContainerDied","Data":"cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a"}
Oct 30 16:39:41.225376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.225230    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"
Oct 30 16:39:41.225376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.225250    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466" event={"ID":"af98f09a-061a-4c99-b351-30d4c047ea5e","Type":"ContainerDied","Data":"15409ee841824ead5af57b2132b6fd99e9815c9ae3567e1d71af6cf267e966c6"}
Oct 30 16:39:41.225376 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.225281    5101 scope.go:122] "RemoveContainer" containerID="cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a"
Oct 30 16:39:41.227150 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.227125    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5" event={"ID":"588f354f-5e74-4a4e-a482-285991ec20a6","Type":"ContainerDied","Data":"538b24c72f410c5f24059f78bfda402ec6a26ac0bc425003948b550535c4a5dc"}
Oct 30 16:39:41.227264 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.227135    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"
Oct 30 16:39:41.228917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.228893    5101 generic.go:356] "Generic (PLEG): container finished" podID="3e727bca-9076-45eb-85d1-578c713eee37" containerID="71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2" exitCode=0
Oct 30 16:39:41.229005 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.228979    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"
Oct 30 16:39:41.229084 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.229010    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" event={"ID":"3e727bca-9076-45eb-85d1-578c713eee37","Type":"ContainerDied","Data":"71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2"}
Oct 30 16:39:41.229084 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.229050    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn" event={"ID":"3e727bca-9076-45eb-85d1-578c713eee37","Type":"ContainerDied","Data":"4fa2446cebf393a3e77ab00deace213424a44e044ee1dfbf21fb5281e5695f8a"}
Oct 30 16:39:41.230618 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.230599    5101 generic.go:356] "Generic (PLEG): container finished" podID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerID="a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54" exitCode=0
Oct 30 16:39:41.230707 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.230685    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"
Oct 30 16:39:41.230771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.230702    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" event={"ID":"b3b6dbca-b179-4b3c-9012-90bb31fc71da","Type":"ContainerDied","Data":"a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54"}
Oct 30 16:39:41.230771 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.230738    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg" event={"ID":"b3b6dbca-b179-4b3c-9012-90bb31fc71da","Type":"ContainerDied","Data":"12bc3a326be328d0b6c4ceca178bb9436d45d3204348a83971114e1ca5b5e4f2"}
Oct 30 16:39:41.232257 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.232240    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"
Oct 30 16:39:41.232638 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.232279    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6" event={"ID":"f5eca49e-b247-415e-9f7f-c60a579d3fa5","Type":"ContainerDied","Data":"6fc0f9293e725eceb5e0b2bef50c2718091c1f36dffe29240f8b4b7a7851d8bb"}
Oct 30 16:39:41.234272 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.234224    5101 generic.go:356] "Generic (PLEG): container finished" podID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerID="69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3" exitCode=0
Oct 30 16:39:41.234389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.234287    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" event={"ID":"eb69f0da-4c6f-4cec-b805-52e1f730140d","Type":"ContainerDied","Data":"69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3"}
Oct 30 16:39:41.234389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.234312    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm" event={"ID":"eb69f0da-4c6f-4cec-b805-52e1f730140d","Type":"ContainerDied","Data":"16c134e9b8c693fe775c036d02cc1aed4b1cc5e6601ca2f1ae47b91c675f7de8"}
Oct 30 16:39:41.234505 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.234447    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"
Oct 30 16:39:41.235818 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.235796    5101 generic.go:356] "Generic (PLEG): container finished" podID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerID="f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c" exitCode=0
Oct 30 16:39:41.235911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.235826    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" event={"ID":"a0cc338c-3c25-4160-aeda-6521e261f4c6","Type":"ContainerDied","Data":"f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c"}
Oct 30 16:39:41.235911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.235861    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h" event={"ID":"a0cc338c-3c25-4160-aeda-6521e261f4c6","Type":"ContainerDied","Data":"d9e86f0c62df2c3b97ab38a0b35f93191b3b59597c2f0d30bd350ed611bf0322"}
Oct 30 16:39:41.235911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.235863    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"
Oct 30 16:39:41.236085 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.235954    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:39:41.238692 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.238675    5101 scope.go:122] "RemoveContainer" containerID="cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a"
Oct 30 16:39:41.238925 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:41.238902    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a\": container with ID starting with cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a not found: ID does not exist" containerID="cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a"
Oct 30 16:39:41.239021 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.238930    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a"} err="failed to get container status \"cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a\": rpc error: code = NotFound desc = could not find container \"cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a\": container with ID starting with cfa654e94aa52ffc968f5480e1688930ca3321ae9fe7bda705ebd3684042e92a not found: ID does not exist"
Oct 30 16:39:41.239021 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.238954    5101 scope.go:122] "RemoveContainer" containerID="5dc244d9b7703d53d734f6ad77b82d9e047aba026ad5cf1e2060a68338f52987"
Oct 30 16:39:41.241171 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.241150    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:39:41.241872 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.241855    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:39:41.245983 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.245966    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:39:41.249900 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.249889    5101 scope.go:122] "RemoveContainer" containerID="71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2"
Oct 30 16:39:41.258911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.258895    5101 scope.go:122] "RemoveContainer" containerID="71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2"
Oct 30 16:39:41.259133 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:41.259114    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2\": container with ID starting with 71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2 not found: ID does not exist" containerID="71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2"
Oct 30 16:39:41.259174 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.259139    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2"} err="failed to get container status \"71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2\": rpc error: code = NotFound desc = could not find container \"71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2\": container with ID starting with 71923fbf768edfae25c2e4b36e20f13342a8cd5e43db73d81f8ae3b2164e25a2 not found: ID does not exist"
Oct 30 16:39:41.259174 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.259153    5101 scope.go:122] "RemoveContainer" containerID="a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54"
Oct 30 16:39:41.267053 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.267037    5101 scope.go:122] "RemoveContainer" containerID="a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54"
Oct 30 16:39:41.267280 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:41.267265    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54\": container with ID starting with a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54 not found: ID does not exist" containerID="a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54"
Oct 30 16:39:41.267328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.267287    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54"} err="failed to get container status \"a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54\": rpc error: code = NotFound desc = could not find container \"a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54\": container with ID starting with a5719c3f872ac4371dd2e373575b3266584ae93fe7e2d1b1ecc383fee38afa54 not found: ID does not exist"
Oct 30 16:39:41.267328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.267301    5101 scope.go:122] "RemoveContainer" containerID="64bd4e9088efc4893e64558046b4019e79629500bb9a5093dbfbda8317e5c530"
Oct 30 16:39:41.275474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.275458    5101 scope.go:122] "RemoveContainer" containerID="69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3"
Oct 30 16:39:41.277871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.277853    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"]
Oct 30 16:39:41.284804 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.284775    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-nvzjm"]
Oct 30 16:39:41.303533 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.303510    5101 scope.go:122] "RemoveContainer" containerID="69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3"
Oct 30 16:39:41.303884 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:41.303855    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3\": container with ID starting with 69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3 not found: ID does not exist" containerID="69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3"
Oct 30 16:39:41.304012 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.303894    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3"} err="failed to get container status \"69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3\": rpc error: code = NotFound desc = could not find container \"69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3\": container with ID starting with 69c73a5a0df4470a3d7558cd65306e8a1e19a5a132da62e5bb9e56786fbb15c3 not found: ID does not exist"
Oct 30 16:39:41.304012 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.303912    5101 scope.go:122] "RemoveContainer" containerID="f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c"
Oct 30 16:39:41.327957 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.327926    5101 scope.go:122] "RemoveContainer" containerID="f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c"
Oct 30 16:39:41.358860 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.332686    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"]
Oct 30 16:39:41.358860 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:41.332832    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c\": container with ID starting with f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c not found: ID does not exist" containerID="f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c"
Oct 30 16:39:41.358860 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.332862    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c"} err="failed to get container status \"f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c\": rpc error: code = NotFound desc = could not find container \"f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c\": container with ID starting with f879edeb6444c49bc1e79566f7fa8a49b525d678046f48f9e2773a24433abe4c not found: ID does not exist"
Oct 30 16:39:41.358860 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.335755    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-5wf6h"]
Oct 30 16:39:41.379813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.379781    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"]
Oct 30 16:39:41.387992 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.387964    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2hxkn"]
Oct 30 16:39:41.426713 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.425969    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"]
Oct 30 16:39:41.431827 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.431797    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-2l466"]
Oct 30 16:39:41.461016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.460985    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"]
Oct 30 16:39:41.472637 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.472584    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-rqgmg"]
Oct 30 16:39:41.511076 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.511048    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"]
Oct 30 16:39:41.515263 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.515232    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9p7r6"]
Oct 30 16:39:41.536668 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.536645    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main" containerID="cri-o://e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038" gracePeriod=45
Oct 30 16:39:41.542844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.542824    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"]
Oct 30 16:39:41.547951 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.547926    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-ngkn5"]
Oct 30 16:39:41.679805 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.679769    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:41.864382 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.863554    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:41.869180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:41.869155    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:39:42.022497 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.022463    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tls-certs\") pod \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") "
Oct 30 16:39:42.022687 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.022540    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tmp-dir\") pod \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") "
Oct 30 16:39:42.022687 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.022652    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-dshm\") pod \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") "
Oct 30 16:39:42.022805 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.022715    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-home\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-home\") pod \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") "
Oct 30 16:39:42.022859 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.022807    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-model-cache\") pod \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") "
Oct 30 16:39:42.022859 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.022839    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-kube-api-access-2rmsp\" (UniqueName: \"kubernetes.io/projected/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-kube-api-access-2rmsp\") pod \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\" (UID: \"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d\") "
Oct 30 16:39:42.023463 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.023429    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-home" pod "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" (UID: "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:42.023585 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.023504    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-model-cache" pod "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" (UID: "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:42.023719 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.023693    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tmp-dir" pod "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" (UID: "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:42.028604 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.028548    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-kube-api-access-2rmsp" pod "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" (UID: "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d"). InnerVolumeSpecName "kube-api-access-2rmsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:42.028844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.028810    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-dshm" pod "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" (UID: "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:42.029887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.029859    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tls-certs" pod "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" (UID: "2ab67649-1d10-49fd-9c99-35c2ab8b5e6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:42.128514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.128299    5101 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-dshm\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.128514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.128354    5101 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-home\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.128514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.128370    5101 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-model-cache\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.128514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.128387    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rmsp\" (UniqueName: \"kubernetes.io/projected/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-kube-api-access-2rmsp\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.128514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.128399    5101 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tls-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.128514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.128440    5101 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d-tmp-dir\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.302500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.302463    5101 generic.go:356] "Generic (PLEG): container finished" podID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerID="e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038" exitCode=0
Oct 30 16:39:42.307360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.302905    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" event={"ID":"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d","Type":"ContainerDied","Data":"e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038"}
Oct 30 16:39:42.325042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.307538    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp" event={"ID":"2ab67649-1d10-49fd-9c99-35c2ab8b5e6d","Type":"ContainerDied","Data":"83f09d56ebb0b8f3996a8ba4741f574f8c4f17627526d850652f943e1b4b9c7a"}
Oct 30 16:39:42.325647 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.316499    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"
Oct 30 16:39:42.326284 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.326256    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:42.331391 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.316791    5101 scope.go:122] "RemoveContainer" containerID="e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038"
Oct 30 16:39:42.351162 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.342388    5101 scope.go:122] "RemoveContainer" containerID="e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038"
Oct 30 16:39:42.356565 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:42.356453    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038\": container with ID starting with e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038 not found: ID does not exist" containerID="e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038"
Oct 30 16:39:42.356565 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.356495    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038"} err="failed to get container status \"e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038\": rpc error: code = NotFound desc = could not find container \"e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038\": container with ID starting with e588c0b05c2319467b5a8a1d2f82352da9cf06607ea740717d62b6d4fd7fa038 not found: ID does not exist"
Oct 30 16:39:42.403707 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.403684    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"]
Oct 30 16:39:42.420227 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:42.420204    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-w1-b55521-kserve-657955df9d-ttbbp"]
Oct 30 16:39:43.076075 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:43.076039    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" path="/var/lib/kubelet/pods/2ab67649-1d10-49fd-9c99-35c2ab8b5e6d/volumes"
Oct 30 16:39:43.076549 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:43.076534    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e727bca-9076-45eb-85d1-578c713eee37" path="/var/lib/kubelet/pods/3e727bca-9076-45eb-85d1-578c713eee37/volumes"
Oct 30 16:39:43.076958 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:43.076946    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" path="/var/lib/kubelet/pods/588f354f-5e74-4a4e-a482-285991ec20a6/volumes"
Oct 30 16:39:43.077684 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:43.077669    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" path="/var/lib/kubelet/pods/a0cc338c-3c25-4160-aeda-6521e261f4c6/volumes"
Oct 30 16:39:43.078063 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:43.078050    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" path="/var/lib/kubelet/pods/af98f09a-061a-4c99-b351-30d4c047ea5e/volumes"
Oct 30 16:39:43.078454 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:43.078441    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" path="/var/lib/kubelet/pods/b3b6dbca-b179-4b3c-9012-90bb31fc71da/volumes"
Oct 30 16:39:43.079080 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:43.079066    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" path="/var/lib/kubelet/pods/eb69f0da-4c6f-4cec-b805-52e1f730140d/volumes"
Oct 30 16:39:43.079531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:43.079515    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" path="/var/lib/kubelet/pods/f5eca49e-b247-415e-9f7f-c60a579d3fa5/volumes"
Oct 30 16:39:44.532189 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:44.532157    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"]
Oct 30 16:39:44.532707 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:44.532389    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj" podUID="0927813f-c8b2-443d-94b2-7722c0ab94e3" containerName="maas-api" containerID="cri-o://77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad" gracePeriod=30
Oct 30 16:39:44.649090 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:44.649044    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:45.063252 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.058263    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:39:45.158870 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.158803    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-maas-api-tls\") pod \"0927813f-c8b2-443d-94b2-7722c0ab94e3\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") "
Oct 30 16:39:45.159050 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.158954    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0927813f-c8b2-443d-94b2-7722c0ab94e3-kube-api-access-gcr9k\" (UniqueName: \"kubernetes.io/projected/0927813f-c8b2-443d-94b2-7722c0ab94e3-kube-api-access-gcr9k\") pod \"0927813f-c8b2-443d-94b2-7722c0ab94e3\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") "
Oct 30 16:39:45.159118 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.159048    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-metrics-certs\") pod \"0927813f-c8b2-443d-94b2-7722c0ab94e3\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") "
Oct 30 16:39:45.159182 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.159130    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0927813f-c8b2-443d-94b2-7722c0ab94e3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927813f-c8b2-443d-94b2-7722c0ab94e3-openshift-service-ca\") pod \"0927813f-c8b2-443d-94b2-7722c0ab94e3\" (UID: \"0927813f-c8b2-443d-94b2-7722c0ab94e3\") "
Oct 30 16:39:45.160244 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.160214    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0927813f-c8b2-443d-94b2-7722c0ab94e3-openshift-service-ca" pod "0927813f-c8b2-443d-94b2-7722c0ab94e3" (UID: "0927813f-c8b2-443d-94b2-7722c0ab94e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:45.161949 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.161920    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-metrics-certs" pod "0927813f-c8b2-443d-94b2-7722c0ab94e3" (UID: "0927813f-c8b2-443d-94b2-7722c0ab94e3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:45.162518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.162490    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-maas-api-tls" pod "0927813f-c8b2-443d-94b2-7722c0ab94e3" (UID: "0927813f-c8b2-443d-94b2-7722c0ab94e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:45.162602 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.162532    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0927813f-c8b2-443d-94b2-7722c0ab94e3-kube-api-access-gcr9k" pod "0927813f-c8b2-443d-94b2-7722c0ab94e3" (UID: "0927813f-c8b2-443d-94b2-7722c0ab94e3"). InnerVolumeSpecName "kube-api-access-gcr9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:45.173703 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.173674    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:45.255693 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.255656    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"]
Oct 30 16:39:45.260940 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.260903    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-maas-api-tls\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:45.260940 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.260941    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcr9k\" (UniqueName: \"kubernetes.io/projected/0927813f-c8b2-443d-94b2-7722c0ab94e3-kube-api-access-gcr9k\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:45.261383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.260954    5101 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0927813f-c8b2-443d-94b2-7722c0ab94e3-metrics-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:45.261383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.260967    5101 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927813f-c8b2-443d-94b2-7722c0ab94e3-openshift-service-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:45.262138 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.262107    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b55521-pn42k"]
Oct 30 16:39:45.314781 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.314704    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:45.353288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.353251    5101 generic.go:356] "Generic (PLEG): container finished" podID="0927813f-c8b2-443d-94b2-7722c0ab94e3" containerID="77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad" exitCode=0
Oct 30 16:39:45.353469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.353320    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"
Oct 30 16:39:45.353469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.353325    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj" event={"ID":"0927813f-c8b2-443d-94b2-7722c0ab94e3","Type":"ContainerDied","Data":"77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad"}
Oct 30 16:39:45.353469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.353409    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj" event={"ID":"0927813f-c8b2-443d-94b2-7722c0ab94e3","Type":"ContainerDied","Data":"c613236ad8db5c1831889345f979b8c5aa266cb1a83b621f22ca9306b3979876"}
Oct 30 16:39:45.353469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.353435    5101 scope.go:122] "RemoveContainer" containerID="77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad"
Oct 30 16:39:45.363905 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.363887    5101 scope.go:122] "RemoveContainer" containerID="77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad"
Oct 30 16:39:45.364179 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:45.364159    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad\": container with ID starting with 77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad not found: ID does not exist" containerID="77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad"
Oct 30 16:39:45.364218 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.364188    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad"} err="failed to get container status \"77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad\": rpc error: code = NotFound desc = could not find container \"77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad\": container with ID starting with 77deed90f82665dc69936ad0878e0c0cb6a13e2b8aef55399d6d5b881dac3fad not found: ID does not exist"
Oct 30 16:39:45.407172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.407143    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"]
Oct 30 16:39:45.410717 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.410695    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b55521-88d9645bc-7smcj"]
Oct 30 16:39:45.816294 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:45.816263    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:46.256715 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:46.256678    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:47.074074 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:47.074043    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0927813f-c8b2-443d-94b2-7722c0ab94e3" path="/var/lib/kubelet/pods/0927813f-c8b2-443d-94b2-7722c0ab94e3/volumes"
Oct 30 16:39:47.074503 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:47.074489    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f7431cf-efd4-4a99-a5d9-a73767c0cf0a" path="/var/lib/kubelet/pods/1f7431cf-efd4-4a99-a5d9-a73767c0cf0a/volumes"
Oct 30 16:39:48.774885 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:48.774851    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:48.928348 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:48.928300    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:49.094055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:49.093973    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"]
Oct 30 16:39:49.094507 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:49.094478    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy" containerID="cri-o://6f05047d942a3b06c56c4a403cba5698d05a7bcdb3b1d2aba8215dc263b4f14a" gracePeriod=30
Oct 30 16:39:49.107565 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:49.107540    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"]
Oct 30 16:39:49.107770 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:49.107747    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy" containerID="cri-o://55d3840b561e0747a0663c517caf9439e43e5d2db2f6a2abb119904876bc7797" gracePeriod=30
Oct 30 16:39:49.120733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:49.120706    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"]
Oct 30 16:39:49.120936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:49.120897    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy" containerID="cri-o://0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f" gracePeriod=30
Oct 30 16:39:49.221443 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:49.221396    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:50.291936 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:50.291899    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:39:50.833844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:50.833810    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:50.990176 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:50.990141    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:51.270388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:51.270297    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:51.642286 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:51.642238    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:52.745911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:52.745873    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:53.074687 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.074600    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:53.302686 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.302653    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:53.397451 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.397417    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"]
Oct 30 16:39:53.397719 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.397693    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy" containerID="cri-o://5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3" gracePeriod=30
Oct 30 16:39:53.414628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.413593    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"]
Oct 30 16:39:53.414628 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.413874    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy" containerID="cri-o://52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57" gracePeriod=30
Oct 30 16:39:53.417130 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.417104    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"]
Oct 30 16:39:53.417299 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.417280    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy" containerID="cri-o://bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57" gracePeriod=30
Oct 30 16:39:53.513005 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:53.512956    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:54.406769 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.406741    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:39:54.416228 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.416197    5101 generic.go:356] "Generic (PLEG): container finished" podID="36089829-4672-4052-9efa-f09ab6c5be2e" containerID="6f05047d942a3b06c56c4a403cba5698d05a7bcdb3b1d2aba8215dc263b4f14a" exitCode=0
Oct 30 16:39:54.416401 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.416381    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" event={"ID":"36089829-4672-4052-9efa-f09ab6c5be2e","Type":"ContainerDied","Data":"6f05047d942a3b06c56c4a403cba5698d05a7bcdb3b1d2aba8215dc263b4f14a"}
Oct 30 16:39:54.416480 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.416436    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm" event={"ID":"36089829-4672-4052-9efa-f09ab6c5be2e","Type":"ContainerDied","Data":"542f708e0980573e364a29b364403a56e32c40c8bd75ac140769d5ade97fe352"}
Oct 30 16:39:54.416480 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.416461    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="542f708e0980573e364a29b364403a56e32c40c8bd75ac140769d5ade97fe352"
Oct 30 16:39:54.418469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.418443    5101 generic.go:356] "Generic (PLEG): container finished" podID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerID="55d3840b561e0747a0663c517caf9439e43e5d2db2f6a2abb119904876bc7797" exitCode=0
Oct 30 16:39:54.418580 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.418472    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" event={"ID":"2637f4a9-81ac-4c7f-beef-446cf3358d7d","Type":"ContainerDied","Data":"55d3840b561e0747a0663c517caf9439e43e5d2db2f6a2abb119904876bc7797"}
Oct 30 16:39:54.434322 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.434276    5101 generic.go:356] "Generic (PLEG): container finished" podID="d396123a-1308-4787-b783-e0a514bdae53" containerID="0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f" exitCode=0
Oct 30 16:39:54.434527 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.434481    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"
Oct 30 16:39:54.434918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.434612    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" event={"ID":"d396123a-1308-4787-b783-e0a514bdae53","Type":"ContainerDied","Data":"0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f"}
Oct 30 16:39:54.434918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.434708    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8" event={"ID":"d396123a-1308-4787-b783-e0a514bdae53","Type":"ContainerDied","Data":"e0eb9525520f634083883dc891a34f3a2ec716321f02cc2006cf82dd4e13c728"}
Oct 30 16:39:54.434918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.434754    5101 scope.go:122] "RemoveContainer" containerID="0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f"
Oct 30 16:39:54.441694 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.441663    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:39:54.446970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.446944    5101 scope.go:122] "RemoveContainer" containerID="b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc"
Oct 30 16:39:54.459927 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.459898    5101 scope.go:122] "RemoveContainer" containerID="0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f"
Oct 30 16:39:54.460237 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:54.460206    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f\": container with ID starting with 0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f not found: ID does not exist" containerID="0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f"
Oct 30 16:39:54.460322 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.460238    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f"} err="failed to get container status \"0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f\": rpc error: code = NotFound desc = could not find container \"0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f\": container with ID starting with 0bad8dd1e09956e06538a5a8fa298098e44089624ffd78fe6839369f82fb625f not found: ID does not exist"
Oct 30 16:39:54.460322 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.460261    5101 scope.go:122] "RemoveContainer" containerID="b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc"
Oct 30 16:39:54.460616 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:54.460595    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc\": container with ID starting with b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc not found: ID does not exist" containerID="b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc"
Oct 30 16:39:54.460685 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.460622    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc"} err="failed to get container status \"b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc\": rpc error: code = NotFound desc = could not find container \"b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc\": container with ID starting with b5b15e74bd77cf39ffd81efd91c95517f236c317ebe8c2fc62dfa67e5c72a2bc not found: ID does not exist"
Oct 30 16:39:54.467262 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.467241    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:39:54.475172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475143    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-credential-socket\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.475363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475226    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-socket\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.475363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475265    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-certs\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.475363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475293    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-data\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.475524 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475382    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-istio-token\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-istio-token\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.475524 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475426    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-kube-api-access-p6wz6\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-kube-api-access-p6wz6\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.475524 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475469    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d396123a-1308-4787-b783-e0a514bdae53-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396123a-1308-4787-b783-e0a514bdae53-istiod-ca-cert\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.475673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475551    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-envoy\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.475673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.475590    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d396123a-1308-4787-b783-e0a514bdae53-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396123a-1308-4787-b783-e0a514bdae53-istio-podinfo\") pod \"d396123a-1308-4787-b783-e0a514bdae53\" (UID: \"d396123a-1308-4787-b783-e0a514bdae53\") "
Oct 30 16:39:54.476052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.476024    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-data" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.476052 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.476044    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-certs" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.476270 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.476249    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-credential-socket" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.476569 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.476546    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d396123a-1308-4787-b783-e0a514bdae53-istiod-ca-cert" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:54.477404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.477379    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-socket" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.478918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.478894    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-envoy" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.479020 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.478940    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-kube-api-access-p6wz6" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "kube-api-access-p6wz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.479767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.479741    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d396123a-1308-4787-b783-e0a514bdae53-istio-podinfo" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:54.480901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.480879    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-istio-token" pod "d396123a-1308-4787-b783-e0a514bdae53" (UID: "d396123a-1308-4787-b783-e0a514bdae53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.576953 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.576917    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-kube-api-access-lhlsj\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-kube-api-access-lhlsj\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.576953 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.576954    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/36089829-4672-4052-9efa-f09ab6c5be2e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36089829-4672-4052-9efa-f09ab6c5be2e-istio-podinfo\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.577148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.576979    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-kube-api-access-br27x\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-kube-api-access-br27x\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.577148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577020    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-certs\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.577148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577045    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-data\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.577148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577100    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-envoy\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.577369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577150    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-data\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.577369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577201    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-credential-socket\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.577369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577233    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-certs\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.577369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577267    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-envoy\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.577574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577380    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-podinfo\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.577574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577401    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-data" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.577574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577399    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-certs" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.577574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577409    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-credential-socket\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.577574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577505    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36089829-4672-4052-9efa-f09ab6c5be2e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36089829-4672-4052-9efa-f09ab6c5be2e-istiod-ca-cert\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.577756 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577576    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-socket\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.577756 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577617    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-credential-socket" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.577756 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577638    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-certs" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.577756 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577645    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-istio-token\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-istio-token\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.577756 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577663    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-data" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.577756 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577718    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-token\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-token\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.578004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577762    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-socket\") pod \"36089829-4672-4052-9efa-f09ab6c5be2e\" (UID: \"36089829-4672-4052-9efa-f09ab6c5be2e\") "
Oct 30 16:39:54.578004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577840    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istiod-ca-cert\") pod \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\" (UID: \"2637f4a9-81ac-4c7f-beef-446cf3358d7d\") "
Oct 30 16:39:54.578004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577855    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-credential-socket" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.578004 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.577915    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36089829-4672-4052-9efa-f09ab6c5be2e-istiod-ca-cert" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:54.578136 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578058    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-socket" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.578412 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578386    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istiod-ca-cert" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:54.578494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578439    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578461    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6wz6\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-kube-api-access-p6wz6\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578477    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396123a-1308-4787-b783-e0a514bdae53-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578491    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578503    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578516    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578529    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578542    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36089829-4672-4052-9efa-f09ab6c5be2e-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578554    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578567    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396123a-1308-4787-b783-e0a514bdae53-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578580    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578592    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578605    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578609    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-socket" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578619    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.578634 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578631    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.579055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578642    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396123a-1308-4787-b783-e0a514bdae53-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.579055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.578653    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396123a-1308-4787-b783-e0a514bdae53-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.580305 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.580274    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-kube-api-access-br27x" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "kube-api-access-br27x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.580738 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.580687    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-istio-token" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.580850 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.580778    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-envoy" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.581018 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.580982    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36089829-4672-4052-9efa-f09ab6c5be2e-istio-podinfo" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:54.581288 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.581264    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-token" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.581443 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.581298    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-kube-api-access-lhlsj" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "kube-api-access-lhlsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.581518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.581456    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-podinfo" pod "2637f4a9-81ac-4c7f-beef-446cf3358d7d" (UID: "2637f4a9-81ac-4c7f-beef-446cf3358d7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:54.582579 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.582055    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-envoy" pod "36089829-4672-4052-9efa-f09ab6c5be2e" (UID: "36089829-4672-4052-9efa-f09ab6c5be2e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.679834 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679800    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhlsj\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-kube-api-access-lhlsj\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.679834 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679832    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36089829-4672-4052-9efa-f09ab6c5be2e-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.679834 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679842    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br27x\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-kube-api-access-br27x\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.680037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679851    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.680037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679859    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.680037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679866    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.680037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679873    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36089829-4672-4052-9efa-f09ab6c5be2e-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.680037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679880    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.680037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679887    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36089829-4672-4052-9efa-f09ab6c5be2e-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.680037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.679894    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2637f4a9-81ac-4c7f-beef-446cf3358d7d-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.782032 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.782000    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"]
Oct 30 16:39:54.785912 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:54.785886    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-4hgr8"]
Oct 30 16:39:55.075240 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.075158    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d396123a-1308-4787-b783-e0a514bdae53" path="/var/lib/kubelet/pods/d396123a-1308-4787-b783-e0a514bdae53/volumes"
Oct 30 16:39:55.267292 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.267247    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:55.267473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.267314    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:55.442464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.442433    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"
Oct 30 16:39:55.442464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.442452    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7" event={"ID":"2637f4a9-81ac-4c7f-beef-446cf3358d7d","Type":"ContainerDied","Data":"fdb39e05f3d66670eeaed9a24ba4db3e088bc84cf45040cce8a7bb873cd34b82"}
Oct 30 16:39:55.442984 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.442523    5101 scope.go:122] "RemoveContainer" containerID="55d3840b561e0747a0663c517caf9439e43e5d2db2f6a2abb119904876bc7797"
Oct 30 16:39:55.444281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.443820    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"
Oct 30 16:39:55.498669 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.498636    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"]
Oct 30 16:39:55.511594 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.511561    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-nd8zm"]
Oct 30 16:39:55.547889 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.547849    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"]
Oct 30 16:39:55.553020 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:55.552993    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lvlz7"]
Oct 30 16:39:56.219608 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:56.219573    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:56.219899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:56.219643    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:57.074531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:57.074495    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" path="/var/lib/kubelet/pods/2637f4a9-81ac-4c7f-beef-446cf3358d7d/volumes"
Oct 30 16:39:57.075140 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:57.075120    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" path="/var/lib/kubelet/pods/36089829-4672-4052-9efa-f09ab6c5be2e/volumes"
Oct 30 16:39:57.282742 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:57.282711    5101 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:57.282961 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:57.282777    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:58.132862 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.132819    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85bb7dd889-frdsz"]
Oct 30 16:39:58.133385 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.133095    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-85bb7dd889-frdsz" podUID="0ba1ef36-def2-4766-b957-9dd2e574165c" containerName="manager" containerID="cri-o://186090d6d348d3de9b7fb8ff56660a670384eff63d1f70ebbbe12d3e9c40b051" gracePeriod=30
Oct 30 16:39:58.482672 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.482632    5101 generic.go:356] "Generic (PLEG): container finished" podID="0ba1ef36-def2-4766-b957-9dd2e574165c" containerID="186090d6d348d3de9b7fb8ff56660a670384eff63d1f70ebbbe12d3e9c40b051" exitCode=0
Oct 30 16:39:58.482816 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.482691    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85bb7dd889-frdsz" event={"ID":"0ba1ef36-def2-4766-b957-9dd2e574165c","Type":"ContainerDied","Data":"186090d6d348d3de9b7fb8ff56660a670384eff63d1f70ebbbe12d3e9c40b051"}
Oct 30 16:39:58.667449 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.667413    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:39:58.732837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.730070    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ba1ef36-def2-4766-b957-9dd2e574165c-kube-api-access-68t7l\" (UniqueName: \"kubernetes.io/projected/0ba1ef36-def2-4766-b957-9dd2e574165c-kube-api-access-68t7l\") pod \"0ba1ef36-def2-4766-b957-9dd2e574165c\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") "
Oct 30 16:39:58.732837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.730153    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-metrics-certs\") pod \"0ba1ef36-def2-4766-b957-9dd2e574165c\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") "
Oct 30 16:39:58.732837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.730966    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-webhook-cert\") pod \"0ba1ef36-def2-4766-b957-9dd2e574165c\" (UID: \"0ba1ef36-def2-4766-b957-9dd2e574165c\") "
Oct 30 16:39:58.734500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.734456    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ba1ef36-def2-4766-b957-9dd2e574165c-kube-api-access-68t7l" pod "0ba1ef36-def2-4766-b957-9dd2e574165c" (UID: "0ba1ef36-def2-4766-b957-9dd2e574165c"). InnerVolumeSpecName "kube-api-access-68t7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.748271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.748220    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-metrics-certs" pod "0ba1ef36-def2-4766-b957-9dd2e574165c" (UID: "0ba1ef36-def2-4766-b957-9dd2e574165c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:58.750134 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.750092    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-webhook-cert" pod "0ba1ef36-def2-4766-b957-9dd2e574165c" (UID: "0ba1ef36-def2-4766-b957-9dd2e574165c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:58.755584 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.754939    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:39:58.782821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.782581    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:39:58.832266 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832231    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-envoy\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.832474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832284    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-kube-api-access-45f8t\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-kube-api-access-45f8t\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.832474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832377    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-token\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-token\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.832474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832415    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-podinfo\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.832669 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832563    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65e9e77a-a23f-424d-914d-a44d465dc23a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e9e77a-a23f-424d-914d-a44d465dc23a-istiod-ca-cert\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.832669 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832598    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-certs\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.832669 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832641    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-credential-socket\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.832820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832698    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-data\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.832820 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.832728    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-socket\") pod \"65e9e77a-a23f-424d-914d-a44d465dc23a\" (UID: \"65e9e77a-a23f-424d-914d-a44d465dc23a\") "
Oct 30 16:39:58.838896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.837623    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-certs" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.838896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.838107    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65e9e77a-a23f-424d-914d-a44d465dc23a-istiod-ca-cert" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:58.840915 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.840755    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-credential-socket" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.841645 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.841447    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-data" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.841988    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-socket" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.842191    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e9e77a-a23f-424d-914d-a44d465dc23a-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.842212    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.842226    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.842241    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.842255    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.842267    5101 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-webhook-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.842281    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68t7l\" (UniqueName: \"kubernetes.io/projected/0ba1ef36-def2-4766-b957-9dd2e574165c-kube-api-access-68t7l\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.842380 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.842295    5101 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ba1ef36-def2-4766-b957-9dd2e574165c-metrics-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.843307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.843262    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-envoy" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.843791 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.843757    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-token" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.844735 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.844442    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:39:58.845775 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.845744    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-podinfo" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:58.847886 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.847851    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-kube-api-access-45f8t" pod "65e9e77a-a23f-424d-914d-a44d465dc23a" (UID: "65e9e77a-a23f-424d-914d-a44d465dc23a"). InnerVolumeSpecName "kube-api-access-45f8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.862231 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.862140    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.947658    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-socket\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.947712    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-envoy\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.947755    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-credential-socket\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.947796    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-certs\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.947846    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-socket\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.947891    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-podinfo\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.947945    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istiod-ca-cert\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.947982    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/75f15653-50b0-4b80-ab46-e23d01705c60-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f15653-50b0-4b80-ab46-e23d01705c60-istio-podinfo\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948013    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75f15653-50b0-4b80-ab46-e23d01705c60-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f15653-50b0-4b80-ab46-e23d01705c60-istiod-ca-cert\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948058    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-istio-token\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-istio-token\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948090    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-token\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-token\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948137    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-data\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948238    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-envoy\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948273    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-kube-api-access-cv88s\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-kube-api-access-cv88s\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948310    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-credential-socket\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948376    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-kube-api-access-hr2r6\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-kube-api-access-hr2r6\") pod \"75f15653-50b0-4b80-ab46-e23d01705c60\" (UID: \"75f15653-50b0-4b80-ab46-e23d01705c60\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948441    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-certs\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.948936 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.948480    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-data\") pod \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\" (UID: \"7ae181cf-abfa-4494-a1b2-161bb76d22ca\") "
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.949071    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-socket" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.949668    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.949691    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.949706    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45f8t\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-kube-api-access-45f8t\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.949723    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.949737    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e9e77a-a23f-424d-914d-a44d465dc23a-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.951066    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-credential-socket" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.951260    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-certs" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.951465    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-socket" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.951741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.951456    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-credential-socket" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.952638 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.952362    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-data" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.954968 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.954531    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-certs" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.954968 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.954721    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-data" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.954968 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.954901    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f15653-50b0-4b80-ab46-e23d01705c60-istiod-ca-cert" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:58.955591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.955568    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istiod-ca-cert" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:58.957392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.957302    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-envoy" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.979674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.979633    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-istio-token" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.982768 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.982720    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75f15653-50b0-4b80-ab46-e23d01705c60-istio-podinfo" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:58.983089 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.983027    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-podinfo" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:58.983089 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.983052    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-kube-api-access-hr2r6" pod "75f15653-50b0-4b80-ab46-e23d01705c60" (UID: "75f15653-50b0-4b80-ab46-e23d01705c60"). InnerVolumeSpecName "kube-api-access-hr2r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.983389 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.983351    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-envoy" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.983479 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.983387    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-kube-api-access-cv88s" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "kube-api-access-cv88s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.985699 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:58.985660    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-token" pod "7ae181cf-abfa-4494-a1b2-161bb76d22ca" (UID: "7ae181cf-abfa-4494-a1b2-161bb76d22ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:59.051040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.050994    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051040 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051041    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051055    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051069    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ae181cf-abfa-4494-a1b2-161bb76d22ca-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051083    5101 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051097    5101 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-workload-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051114    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051128    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051140    5101 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75f15653-50b0-4b80-ab46-e23d01705c60-istio-podinfo\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051152    5101 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75f15653-50b0-4b80-ab46-e23d01705c60-istiod-ca-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051165    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051177    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051191    5101 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-data\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051209    5101 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-istio-envoy\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051221    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv88s\" (UniqueName: \"kubernetes.io/projected/7ae181cf-abfa-4494-a1b2-161bb76d22ca-kube-api-access-cv88s\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051235    5101 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75f15653-50b0-4b80-ab46-e23d01705c60-credential-socket\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.051303 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.051249    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr2r6\" (UniqueName: \"kubernetes.io/projected/75f15653-50b0-4b80-ab46-e23d01705c60-kube-api-access-hr2r6\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.559365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.542260    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85bb7dd889-frdsz"
Oct 30 16:39:59.559365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.542263    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85bb7dd889-frdsz" event={"ID":"0ba1ef36-def2-4766-b957-9dd2e574165c","Type":"ContainerDied","Data":"367e4ed0e4cf19272ff72e2243250246c4ee089ebb166ac481e80032d1a4d173"}
Oct 30 16:39:59.559365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.542700    5101 scope.go:122] "RemoveContainer" containerID="186090d6d348d3de9b7fb8ff56660a670384eff63d1f70ebbbe12d3e9c40b051"
Oct 30 16:39:59.591367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.568176    5101 generic.go:356] "Generic (PLEG): container finished" podID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerID="5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3" exitCode=0
Oct 30 16:39:59.591367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.568316    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" event={"ID":"65e9e77a-a23f-424d-914d-a44d465dc23a","Type":"ContainerDied","Data":"5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3"}
Oct 30 16:39:59.591367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.580855    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"
Oct 30 16:39:59.591367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.586987    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz" event={"ID":"65e9e77a-a23f-424d-914d-a44d465dc23a","Type":"ContainerDied","Data":"d90eb5a5d5de18f70a53d25ef74aaa8bc382c75326d68be12dc8aa2a573bba94"}
Oct 30 16:39:59.639321 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.639282    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"
Oct 30 16:39:59.640360 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.640308    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" event={"ID":"75f15653-50b0-4b80-ab46-e23d01705c60","Type":"ContainerDied","Data":"52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57"}
Oct 30 16:39:59.640604 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.640585    5101 generic.go:356] "Generic (PLEG): container finished" podID="75f15653-50b0-4b80-ab46-e23d01705c60" containerID="52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57" exitCode=0
Oct 30 16:39:59.640965 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.640938    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955" event={"ID":"75f15653-50b0-4b80-ab46-e23d01705c60","Type":"ContainerDied","Data":"ed42f9d02249097c7c7a543977751b75749e5158a60a490c24a8ab04a3805c3d"}
Oct 30 16:39:59.646914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.642320    5101 scope.go:122] "RemoveContainer" containerID="5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3"
Oct 30 16:39:59.656505 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.656475    5101 generic.go:356] "Generic (PLEG): container finished" podID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerID="bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57" exitCode=0
Oct 30 16:39:59.663021 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.657185    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"
Oct 30 16:39:59.686371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.657201    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" event={"ID":"7ae181cf-abfa-4494-a1b2-161bb76d22ca","Type":"ContainerDied","Data":"bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57"}
Oct 30 16:39:59.686371 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.683025    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4" event={"ID":"7ae181cf-abfa-4494-a1b2-161bb76d22ca","Type":"ContainerDied","Data":"9ad94ee61c62f2249dade457f4300dbb4c13c9afb2684719f500304b5da43ca7"}
Oct 30 16:39:59.704510 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.687280    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"]
Oct 30 16:39:59.730315 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.729964    5101 scope.go:122] "RemoveContainer" containerID="5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3"
Oct 30 16:39:59.731970 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:59.730592    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3\": container with ID starting with 5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3 not found: ID does not exist" containerID="5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3"
Oct 30 16:39:59.731970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.730633    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3"} err="failed to get container status \"5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3\": rpc error: code = NotFound desc = could not find container \"5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3\": container with ID starting with 5a0e752565e2c71e100dbbf76691aa8fbc15266c5e723175af9fbb43cdd4a9c3 not found: ID does not exist"
Oct 30 16:39:59.731970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.730659    5101 scope.go:122] "RemoveContainer" containerID="52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57"
Oct 30 16:39:59.743295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.743199    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-4t7cz"]
Oct 30 16:39:59.743295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.743259    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85bb7dd889-frdsz"]
Oct 30 16:39:59.775410 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.775328    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85bb7dd889-frdsz"]
Oct 30 16:39:59.780367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.780241    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"]
Oct 30 16:39:59.780367 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.780294    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-g7955"]
Oct 30 16:39:59.826418 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.802115    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"]
Oct 30 16:39:59.826691 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.826664    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-v6hh4"]
Oct 30 16:39:59.914632 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.914585    5101 scope.go:122] "RemoveContainer" containerID="52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57"
Oct 30 16:39:59.915406 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:59.915379    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57\": container with ID starting with 52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57 not found: ID does not exist" containerID="52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57"
Oct 30 16:39:59.915585 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.915558    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57"} err="failed to get container status \"52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57\": rpc error: code = NotFound desc = could not find container \"52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57\": container with ID starting with 52fe3de4dae60deed1b7ae58e0855678c5eb8fae02195bb5fe08a43fa3998b57 not found: ID does not exist"
Oct 30 16:39:59.915708 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.915695    5101 scope.go:122] "RemoveContainer" containerID="bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57"
Oct 30 16:39:59.942523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.937764    5101 scope.go:122] "RemoveContainer" containerID="bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57"
Oct 30 16:39:59.942523 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:39:59.938273    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57\": container with ID starting with bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57 not found: ID does not exist" containerID="bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57"
Oct 30 16:39:59.942523 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:39:59.938296    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57"} err="failed to get container status \"bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57\": rpc error: code = NotFound desc = could not find container \"bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57\": container with ID starting with bbf3c1808d0a4a53db1162621b712d81ede82073a30ceeada368407359a4ba57 not found: ID does not exist"
Oct 30 16:40:01.224998 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:01.224959    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ba1ef36-def2-4766-b957-9dd2e574165c" path="/var/lib/kubelet/pods/0ba1ef36-def2-4766-b957-9dd2e574165c/volumes"
Oct 30 16:40:01.232601 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:01.232570    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" path="/var/lib/kubelet/pods/65e9e77a-a23f-424d-914d-a44d465dc23a/volumes"
Oct 30 16:40:01.233502 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:01.233478    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" path="/var/lib/kubelet/pods/75f15653-50b0-4b80-ab46-e23d01705c60/volumes"
Oct 30 16:40:01.234799 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:01.234778    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" path="/var/lib/kubelet/pods/7ae181cf-abfa-4494-a1b2-161bb76d22ca/volumes"
Oct 30 16:40:03.483577 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:03.483543    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:03.641491 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:03.641458    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:04.448441 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:04.448405    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:06.540222 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:06.540193    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:06.689901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:06.689870    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:10.446772 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:10.446732    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:20.291130 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:40:20.291096    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:40:33.589195 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:33.589148    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:34.928910 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:34.928877    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:37.045237 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:40:37.045202    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:40:50.291617 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:40:50.291573    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:41:10.038856 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:41:10.038825    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:41:10.195608 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:41:10.195576    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:41:11.261518 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:41:11.261482    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:41:20.290441 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:41:20.290404    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:41:24.141970 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:41:24.141892    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:41:29.035494 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:41:29.035453    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"]
Oct 30 16:41:29.095664 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:41:29.095591    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84f07ab6-5zgq5"]
Oct 30 16:41:31.073733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:41:31.073697    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b" path="/var/lib/kubelet/pods/c4edfa72-d616-4ea1-a4aa-f3d0914e8f7b/volumes"
Oct 30 16:41:33.729809 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:41:33.729772    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:41:50.291046 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:41:50.291009    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:42:20.291809 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:42:20.291773    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:42:21.093467 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:42:21.093435    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:42:21.312314 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:42:21.312282    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:42:33.847112 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:42:33.847052    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:42:41.582673 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:42:41.582639    5101 scope.go:122] "RemoveContainer" containerID="893d0f924a6da40745be7a14cd67b2fa45aaf55ea3df0fa287b8c2f6d18512d6"
Oct 30 16:42:41.591786 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:42:41.591764    5101 scope.go:122] "RemoveContainer" containerID="6f05047d942a3b06c56c4a403cba5698d05a7bcdb3b1d2aba8215dc263b4f14a"
Oct 30 16:42:50.290863 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:42:50.290825    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:43:20.290523 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:43:20.290437    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:43:26.030279 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:43:26.030236    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"]
Oct 30 16:43:26.041877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:43:26.041846    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b6ab5e6b-vps5j"]
Oct 30 16:43:27.073917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:43:27.073881    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4723f170-0d72-4ec2-8dc6-0aceb8434f50" path="/var/lib/kubelet/pods/4723f170-0d72-4ec2-8dc6-0aceb8434f50/volumes"
Oct 30 16:43:33.963117 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:43:33.963084    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:43:45.032163 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:43:45.032124    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"]
Oct 30 16:43:45.044221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:43:45.044188    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5b0c572c-pczwc"]
Oct 30 16:43:45.074156 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:43:45.074120    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d543d0df-154c-49b3-a9f6-57ae324ce1bb" path="/var/lib/kubelet/pods/d543d0df-154c-49b3-a9f6-57ae324ce1bb/volumes"
Oct 30 16:43:50.292304 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:43:50.292267    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:44:07.066725 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:07.066685    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"]
Oct 30 16:44:07.078553 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:07.078523    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5276b55f-9drkf"]
Oct 30 16:44:09.082793 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:09.082749    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="904c5e3c-a34f-4905-bcda-cb908a88e1c0" path="/var/lib/kubelet/pods/904c5e3c-a34f-4905-bcda-cb908a88e1c0/volumes"
Oct 30 16:44:11.027642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:11.027603    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"]
Oct 30 16:44:11.039261 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:11.039232    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ea7827dc-ml2jp"]
Oct 30 16:44:11.073941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:11.073907    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c0406f0-7956-48bb-8a87-135ac4487eba" path="/var/lib/kubelet/pods/7c0406f0-7956-48bb-8a87-135ac4487eba/volumes"
Oct 30 16:44:16.815681 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:16.815644    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"]
Oct 30 16:44:16.816092 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:16.815844    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl" podUID="428a5f77-e21f-4b1e-8a35-ad9c4408026a" containerName="discovery" containerID="cri-o://a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a" gracePeriod=30
Oct 30 16:44:17.077078 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.077009    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:44:17.164188 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.164156    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-dns-cert\") pod \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") "
Oct 30 16:44:17.164420 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.164211    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-ca-configmap\") pod \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") "
Oct 30 16:44:17.164420 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.164335    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-token\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-token\") pod \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") "
Oct 30 16:44:17.164574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.164439    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/428a5f77-e21f-4b1e-8a35-ad9c4408026a-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/428a5f77-e21f-4b1e-8a35-ad9c4408026a-local-certs\") pod \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") "
Oct 30 16:44:17.164574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.164464    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-cacerts\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-cacerts\") pod \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") "
Oct 30 16:44:17.164574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.164515    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-kubeconfig\") pod \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") "
Oct 30 16:44:17.164574 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.164564    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-kube-api-access-pvrj8\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-kube-api-access-pvrj8\") pod \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\" (UID: \"428a5f77-e21f-4b1e-8a35-ad9c4408026a\") "
Oct 30 16:44:17.164786 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.164639    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-ca-configmap" pod "428a5f77-e21f-4b1e-8a35-ad9c4408026a" (UID: "428a5f77-e21f-4b1e-8a35-ad9c4408026a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:44:17.165073 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.165043    5101 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-ca-configmap\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:44:17.166917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.166875    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-kubeconfig" pod "428a5f77-e21f-4b1e-8a35-ad9c4408026a" (UID: "428a5f77-e21f-4b1e-8a35-ad9c4408026a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:44:17.166917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.166884    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-token" pod "428a5f77-e21f-4b1e-8a35-ad9c4408026a" (UID: "428a5f77-e21f-4b1e-8a35-ad9c4408026a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:44:17.167207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.167181    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-cacerts" pod "428a5f77-e21f-4b1e-8a35-ad9c4408026a" (UID: "428a5f77-e21f-4b1e-8a35-ad9c4408026a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:44:17.167328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.167205    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-dns-cert" pod "428a5f77-e21f-4b1e-8a35-ad9c4408026a" (UID: "428a5f77-e21f-4b1e-8a35-ad9c4408026a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:44:17.167542 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.167516    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-kube-api-access-pvrj8" pod "428a5f77-e21f-4b1e-8a35-ad9c4408026a" (UID: "428a5f77-e21f-4b1e-8a35-ad9c4408026a"). InnerVolumeSpecName "kube-api-access-pvrj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:44:17.167611 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.167576    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428a5f77-e21f-4b1e-8a35-ad9c4408026a-local-certs" pod "428a5f77-e21f-4b1e-8a35-ad9c4408026a" (UID: "428a5f77-e21f-4b1e-8a35-ad9c4408026a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:44:17.266364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.266295    5101 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/428a5f77-e21f-4b1e-8a35-ad9c4408026a-local-certs\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:44:17.266364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.266329    5101 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-cacerts\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:44:17.266364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.266372    5101 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-kubeconfig\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:44:17.266612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.266386    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvrj8\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-kube-api-access-pvrj8\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:44:17.266612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.266398    5101 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-csr-dns-cert\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:44:17.266612 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.266414    5101 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/428a5f77-e21f-4b1e-8a35-ad9c4408026a-istio-token\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:44:17.495239 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.495201    5101 generic.go:356] "Generic (PLEG): container finished" podID="428a5f77-e21f-4b1e-8a35-ad9c4408026a" containerID="a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a" exitCode=0
Oct 30 16:44:17.495473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.495247    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"
Oct 30 16:44:17.495473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.495296    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl" event={"ID":"428a5f77-e21f-4b1e-8a35-ad9c4408026a","Type":"ContainerDied","Data":"a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a"}
Oct 30 16:44:17.495473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.495375    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl" event={"ID":"428a5f77-e21f-4b1e-8a35-ad9c4408026a","Type":"ContainerDied","Data":"73995122f67b4cbcea90c43eb57fec4026a1ce04df69af9cf57ca6db34730a91"}
Oct 30 16:44:17.495473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.495398    5101 scope.go:122] "RemoveContainer" containerID="a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a"
Oct 30 16:44:17.505211 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.505190    5101 scope.go:122] "RemoveContainer" containerID="a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a"
Oct 30 16:44:17.505615 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:44:17.505595    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a\": container with ID starting with a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a not found: ID does not exist" containerID="a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a"
Oct 30 16:44:17.505699 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.505630    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a"} err="failed to get container status \"a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a\": rpc error: code = NotFound desc = could not find container \"a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a\": container with ID starting with a150213aed1fb8b6106e995a8951e4b4d3a33362debbca89aa8c45ea075de97a not found: ID does not exist"
Oct 30 16:44:17.548172 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.548137    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"]
Oct 30 16:44:17.559816 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:17.559782    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-89mvl"]
Oct 30 16:44:19.080735 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:19.080690    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="428a5f77-e21f-4b1e-8a35-ad9c4408026a" path="/var/lib/kubelet/pods/428a5f77-e21f-4b1e-8a35-ad9c4408026a/volumes"
Oct 30 16:44:20.291630 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:44:20.291589    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:44:27.131070 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:27.130986    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:44:34.106553 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:34.106518    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:44:41.280715 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:41.280685    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:44:41.284668 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:41.284642    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:44:41.287620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:41.287594    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:44:41.291370 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:41.291348    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:44:41.671327 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:44:41.671299    5101 scope.go:122] "RemoveContainer" containerID="85dc006cb74b915c531bc76b574e52b8aef7ae1b04d6f875654bbe78195eb188"
Oct 30 16:44:50.291527 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:44:50.291491    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:45:02.708332 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:02.708291    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:03.163774 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:03.163738    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:03.308930 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:03.308899    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:06.423334 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:06.423300    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:06.692152 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:06.692075    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:08.087986 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.087956    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:08.153731 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.153694    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"]
Oct 30 16:45:08.154602 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154581    5101 cpu_manager.go:414] "containerMap: removing container" podUID="1f7431cf-efd4-4a99-a5d9-a73767c0cf0a" containerName="revoke-keys"
Oct 30 16:45:08.154602 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154603    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f7431cf-efd4-4a99-a5d9-a73767c0cf0a" containerName="revoke-keys"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154634    5101 cpu_manager.go:414] "containerMap: removing container" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154642    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154675    5101 cpu_manager.go:414] "containerMap: removing container" podUID="ded8b30e-d48b-46cf-8398-8f9b80f09ebc" containerName="payload-pre-processing"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154684    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ded8b30e-d48b-46cf-8398-8f9b80f09ebc" containerName="payload-pre-processing"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154697    5101 cpu_manager.go:414] "containerMap: removing container" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154704    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154713    5101 cpu_manager.go:414] "containerMap: removing container" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154720    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154738    5101 cpu_manager.go:414] "containerMap: removing container" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154746    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154765    5101 cpu_manager.go:414] "containerMap: removing container" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154772    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154792    5101 cpu_manager.go:414] "containerMap: removing container" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy"
Oct 30 16:45:08.154803 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154799    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154819    5101 cpu_manager.go:414] "containerMap: removing container" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154827    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154843    5101 cpu_manager.go:414] "containerMap: removing container" podUID="6e722e81-9a86-4329-ba68-3f409245dd65" containerName="maas-api"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154856    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e722e81-9a86-4329-ba68-3f409245dd65" containerName="maas-api"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154866    5101 cpu_manager.go:414] "containerMap: removing container" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154872    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154902    5101 cpu_manager.go:414] "containerMap: removing container" podUID="07d3bc60-31d5-4cd8-9ce3-f8d78c380759" containerName="payload-processing"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154910    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07d3bc60-31d5-4cd8-9ce3-f8d78c380759" containerName="payload-processing"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154928    5101 cpu_manager.go:414] "containerMap: removing container" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154936    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154952    5101 cpu_manager.go:414] "containerMap: removing container" podUID="0927813f-c8b2-443d-94b2-7722c0ab94e3" containerName="maas-api"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154958    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0927813f-c8b2-443d-94b2-7722c0ab94e3" containerName="maas-api"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154980    5101 cpu_manager.go:414] "containerMap: removing container" podUID="428a5f77-e21f-4b1e-8a35-ad9c4408026a" containerName="discovery"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.154987    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="428a5f77-e21f-4b1e-8a35-ad9c4408026a" containerName="discovery"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155015    5101 cpu_manager.go:414] "containerMap: removing container" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155022    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155040    5101 cpu_manager.go:414] "containerMap: removing container" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155047    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155060    5101 cpu_manager.go:414] "containerMap: removing container" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155067    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155085    5101 cpu_manager.go:414] "containerMap: removing container" podUID="0ba1ef36-def2-4766-b957-9dd2e574165c" containerName="manager"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155094    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ba1ef36-def2-4766-b957-9dd2e574165c" containerName="manager"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155113    5101 cpu_manager.go:414] "containerMap: removing container" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155120    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155138    5101 cpu_manager.go:414] "containerMap: removing container" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155146    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155421    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f7431cf-efd4-4a99-a5d9-a73767c0cf0a" containerName="revoke-keys"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155449    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155469    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="ded8b30e-d48b-46cf-8398-8f9b80f09ebc" containerName="payload-pre-processing"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155480    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb69f0da-4c6f-4cec-b805-52e1f730140d" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155495    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="588f354f-5e74-4a4e-a482-285991ec20a6" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155505    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="36089829-4672-4052-9efa-f09ab6c5be2e" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155521    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5eca49e-b247-415e-9f7f-c60a579d3fa5" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155533    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="2637f4a9-81ac-4c7f-beef-446cf3358d7d" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155549    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0cc338c-3c25-4160-aeda-6521e261f4c6" containerName="istio-proxy"
Oct 30 16:45:08.155548 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155565    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e722e81-9a86-4329-ba68-3f409245dd65" containerName="maas-api"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155581    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ab67649-1d10-49fd-9c99-35c2ab8b5e6d" containerName="main"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155600    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="07d3bc60-31d5-4cd8-9ce3-f8d78c380759" containerName="payload-processing"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155611    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ae181cf-abfa-4494-a1b2-161bb76d22ca" containerName="istio-proxy"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155627    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="0927813f-c8b2-443d-94b2-7722c0ab94e3" containerName="maas-api"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155646    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="428a5f77-e21f-4b1e-8a35-ad9c4408026a" containerName="discovery"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155662    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="65e9e77a-a23f-424d-914d-a44d465dc23a" containerName="istio-proxy"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155679    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="75f15653-50b0-4b80-ab46-e23d01705c60" containerName="istio-proxy"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155687    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="af98f09a-061a-4c99-b351-30d4c047ea5e" containerName="istio-proxy"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155697    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ba1ef36-def2-4766-b957-9dd2e574165c" containerName="manager"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155712    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3b6dbca-b179-4b3c-9012-90bb31fc71da" containerName="istio-proxy"
Oct 30 16:45:08.157225 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.155720    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e727bca-9076-45eb-85d1-578c713eee37" containerName="istio-proxy"
Oct 30 16:45:08.161615 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.161593    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:08.180090 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.180062    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-3bc669\""
Oct 30 16:45:08.185911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.185877    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/360e4a63-3a2e-4d20-8a86-594a50181c88-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv\" (UID: \"360e4a63-3a2e-4d20-8a86-594a50181c88\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:08.186044 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.185966    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk4xb\" (UniqueName: \"kubernetes.io/projected/360e4a63-3a2e-4d20-8a86-594a50181c88-kube-api-access-nk4xb\") pod \"payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv\" (UID: \"360e4a63-3a2e-4d20-8a86-594a50181c88\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:08.192653 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.192624    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"]
Oct 30 16:45:08.263024 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.262992    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:08.286839 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.286807    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/360e4a63-3a2e-4d20-8a86-594a50181c88-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv\" (UID: \"360e4a63-3a2e-4d20-8a86-594a50181c88\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:08.287035 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.286848    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk4xb\" (UniqueName: \"kubernetes.io/projected/360e4a63-3a2e-4d20-8a86-594a50181c88-kube-api-access-nk4xb\") pod \"payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv\" (UID: \"360e4a63-3a2e-4d20-8a86-594a50181c88\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:08.287651 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.287625    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/360e4a63-3a2e-4d20-8a86-594a50181c88-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv\" (UID: \"360e4a63-3a2e-4d20-8a86-594a50181c88\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:08.314620 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.314586    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk4xb\" (UniqueName: \"kubernetes.io/projected/360e4a63-3a2e-4d20-8a86-594a50181c88-kube-api-access-nk4xb\") pod \"payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv\" (UID: \"360e4a63-3a2e-4d20-8a86-594a50181c88\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:08.474173 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.474141    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:08.771596 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:08.771563    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"]
Oct 30 16:45:08.772590 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:45:08.772556    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360e4a63_3a2e_4d20_8a86_594a50181c88.slice/crio-ef5bfc374a482920fd1fcc23b61e046d23d763e9f09230bcd9ab01dc41c1732f WatchSource:0}: Error finding container ef5bfc374a482920fd1fcc23b61e046d23d763e9f09230bcd9ab01dc41c1732f: Status 404 returned error can't find the container with id ef5bfc374a482920fd1fcc23b61e046d23d763e9f09230bcd9ab01dc41c1732f
Oct 30 16:45:09.781655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:09.781616    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv" event={"ID":"360e4a63-3a2e-4d20-8a86-594a50181c88","Type":"ContainerStarted","Data":"957c567b075ed0c19a65902b9b8b781b118428ae0d897a4dd364fb64ec2689b7"}
Oct 30 16:45:09.782051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:09.781676    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv" event={"ID":"360e4a63-3a2e-4d20-8a86-594a50181c88","Type":"ContainerStarted","Data":"ef5bfc374a482920fd1fcc23b61e046d23d763e9f09230bcd9ab01dc41c1732f"}
Oct 30 16:45:09.782051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:09.781824    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:09.833235 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:09.833183    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv" podStartSLOduration=1.833164456 podStartE2EDuration="1.833164456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:45:09.831372395 +0000 UTC m=+1528.884649998" watchObservedRunningTime="2026-10-30 16:45:09.833164456 +0000 UTC m=+1528.886442063"
Oct 30 16:45:09.921103 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:09.921065    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:11.695613 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:11.695564    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:13.556181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:13.556113    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:15.333795 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:15.333756    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:17.131436 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:17.131401    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:19.192013 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:19.191979    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:20.290981 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:45:20.290940    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:45:20.789416 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:20.789390    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:45:20.874006 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:20.873967    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:21.374529 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:21.374499    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:21.910883 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:21.910851    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:22.059051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:22.059005    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:22.213680 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:22.213595    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:22.640569 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:22.640539    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:23.438369 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:23.438327    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:24.566876 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:24.566836    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:26.340744 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:26.340710    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:28.211543 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:28.211506    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:29.973777 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:29.973740    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:31.600986 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:31.600952    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:33.520500 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:33.520461    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:34.213960 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:34.213857    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:35.258871 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:35.258835    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:36.918792 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:36.918715    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:38.702023 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:38.701992    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:40.360465 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:40.360433    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:41.698143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:41.698114    5101 scope.go:122] "RemoveContainer" containerID="0810865ca3a181f98688ee9c2be8d6e4abbb962e3f0243648d7e9b51a08fe36a"
Oct 30 16:45:41.713638 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:41.713610    5101 scope.go:122] "RemoveContainer" containerID="da26524119de7daaf0f4343d38a6b94fbc75bf73adea40d88939725dbc2f8a9e"
Oct 30 16:45:41.721703 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:41.721684    5101 scope.go:122] "RemoveContainer" containerID="e562b71579dd3eec8cb4ed2acb715abe2fcf3baa4e6e326b2c2c4c523dff7b91"
Oct 30 16:45:41.729234 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:41.729216    5101 scope.go:122] "RemoveContainer" containerID="4870d6cf02a8cd9071c438678d9fa36db615bb24567d12d98e134f3be78fe1b8"
Oct 30 16:45:41.736847 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:41.736828    5101 scope.go:122] "RemoveContainer" containerID="d3f40f6d6c5fde4b4d5e9ef808e87b341d4268d24218bf829ec05339dc17b843"
Oct 30 16:45:42.353718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:42.353675    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:43.981102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:43.981068    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:45.791722 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:45.791686    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:47.000578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.000540    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"]
Oct 30 16:45:47.001037 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.001021    5101 cpu_manager.go:414] "containerMap: removing container" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy"
Oct 30 16:45:47.001105 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.001039    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy"
Oct 30 16:45:47.001143 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.001122    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="d396123a-1308-4787-b783-e0a514bdae53" containerName="istio-proxy"
Oct 30 16:45:47.006285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.006264    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.024801 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.024772    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"]
Oct 30 16:45:47.033855 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.033805    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:45:47.034014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.033888    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:45:47.068404 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.068335    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-xks-ca\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.068588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.068433    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.068588 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.068480    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclvc\" (UniqueName: \"kubernetes.io/projected/8460cd02-1de3-4b2b-947d-8de48f7f6648-kube-api-access-dclvc\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.169280 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.169248    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-xks-ca\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.169509 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.169329    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.169509 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.169401    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclvc\" (UniqueName: \"kubernetes.io/projected/8460cd02-1de3-4b2b-947d-8de48f7f6648-kube-api-access-dclvc\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.170042 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.170020    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.171591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.171565    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-xks-ca\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.193199 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.193172    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclvc\" (UniqueName: \"kubernetes.io/projected/8460cd02-1de3-4b2b-947d-8de48f7f6648-kube-api-access-dclvc\") pod \"maas-api-revoke-sub-48aa8440-nnw9h\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.318920 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.318840    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:47.545247 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.545208    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:47.620809 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.620780    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"]
Oct 30 16:45:47.621218 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:45:47.621192    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8460cd02_1de3_4b2b_947d_8de48f7f6648.slice/crio-0daca9c5fbf613a24607c14f082759d3ce8ebcfbef195dcba41411548893639d WatchSource:0}: Error finding container 0daca9c5fbf613a24607c14f082759d3ce8ebcfbef195dcba41411548893639d: Status 404 returned error can't find the container with id 0daca9c5fbf613a24607c14f082759d3ce8ebcfbef195dcba41411548893639d
Oct 30 16:45:47.975539 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.975503    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h" event={"ID":"8460cd02-1de3-4b2b-947d-8de48f7f6648","Type":"ContainerStarted","Data":"561aa1549fa9c230b004a68c0c6aae7734f0ee40f27c36cf71167f15bbda31c8"}
Oct 30 16:45:47.975674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:47.975563    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h" event={"ID":"8460cd02-1de3-4b2b-947d-8de48f7f6648","Type":"ContainerStarted","Data":"0daca9c5fbf613a24607c14f082759d3ce8ebcfbef195dcba41411548893639d"}
Oct 30 16:45:48.018370 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:48.018294    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h" podStartSLOduration=2.018277914 podStartE2EDuration="2.018277914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:45:48.015140107 +0000 UTC m=+1567.068417717" watchObservedRunningTime="2026-10-30 16:45:48.018277914 +0000 UTC m=+1567.071555523"
Oct 30 16:45:48.983014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:48.982977    5101 generic.go:356] "Generic (PLEG): container finished" podID="8460cd02-1de3-4b2b-947d-8de48f7f6648" containerID="561aa1549fa9c230b004a68c0c6aae7734f0ee40f27c36cf71167f15bbda31c8" exitCode=0
Oct 30 16:45:48.983177 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:48.983018    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h" event={"ID":"8460cd02-1de3-4b2b-947d-8de48f7f6648","Type":"ContainerDied","Data":"561aa1549fa9c230b004a68c0c6aae7734f0ee40f27c36cf71167f15bbda31c8"}
Oct 30 16:45:49.300326 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:49.300248    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:50.129208 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.129182    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:50.204265 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.204238    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8460cd02-1de3-4b2b-947d-8de48f7f6648-kube-api-access-dclvc\" (UniqueName: \"kubernetes.io/projected/8460cd02-1de3-4b2b-947d-8de48f7f6648-kube-api-access-dclvc\") pod \"8460cd02-1de3-4b2b-947d-8de48f7f6648\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") "
Oct 30 16:45:50.204265 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.204269    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-openshift-ca\") pod \"8460cd02-1de3-4b2b-947d-8de48f7f6648\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") "
Oct 30 16:45:50.204478 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.204422    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-xks-ca\") pod \"8460cd02-1de3-4b2b-947d-8de48f7f6648\" (UID: \"8460cd02-1de3-4b2b-947d-8de48f7f6648\") "
Oct 30 16:45:50.204656 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.204631    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-openshift-ca" pod "8460cd02-1de3-4b2b-947d-8de48f7f6648" (UID: "8460cd02-1de3-4b2b-947d-8de48f7f6648"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:45:50.206392 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.206372    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-xks-ca" pod "8460cd02-1de3-4b2b-947d-8de48f7f6648" (UID: "8460cd02-1de3-4b2b-947d-8de48f7f6648"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:45:50.206459 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.206393    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8460cd02-1de3-4b2b-947d-8de48f7f6648-kube-api-access-dclvc" pod "8460cd02-1de3-4b2b-947d-8de48f7f6648" (UID: "8460cd02-1de3-4b2b-947d-8de48f7f6648"). InnerVolumeSpecName "kube-api-access-dclvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:45:50.290526 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:45:50.290451    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:45:50.306178 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.306152    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:45:50.306178 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.306178    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dclvc\" (UniqueName: \"kubernetes.io/projected/8460cd02-1de3-4b2b-947d-8de48f7f6648-kube-api-access-dclvc\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:45:50.306595 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.306188    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8460cd02-1de3-4b2b-947d-8de48f7f6648-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:45:50.994250 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.994219    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"
Oct 30 16:45:50.994446 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.994256    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h" event={"ID":"8460cd02-1de3-4b2b-947d-8de48f7f6648","Type":"ContainerDied","Data":"0daca9c5fbf613a24607c14f082759d3ce8ebcfbef195dcba41411548893639d"}
Oct 30 16:45:50.994446 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:50.994304    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0daca9c5fbf613a24607c14f082759d3ce8ebcfbef195dcba41411548893639d"
Oct 30 16:45:51.144646 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:51.144615    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:52.784715 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:52.784678    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:54.672726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:54.672650    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:56.388856 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:56.388820    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:58.164522 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.164474    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:58.317214 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.317174    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:58.322810 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.322784    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"]
Oct 30 16:45:58.323286 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.323267    5101 cpu_manager.go:414] "containerMap: removing container" podUID="8460cd02-1de3-4b2b-947d-8de48f7f6648" containerName="revoke-keys"
Oct 30 16:45:58.323329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.323288    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8460cd02-1de3-4b2b-947d-8de48f7f6648" containerName="revoke-keys"
Oct 30 16:45:58.323400 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.323390    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="8460cd02-1de3-4b2b-947d-8de48f7f6648" containerName="revoke-keys"
Oct 30 16:45:58.326779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.326764    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.348484 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.348458    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"]
Oct 30 16:45:58.357879 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.357856    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:45:58.358008 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.357899    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:45:58.384134 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.384105    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.384264 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.384159    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7wxl\" (UniqueName: \"kubernetes.io/projected/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-kube-api-access-f7wxl\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.384264 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.384234    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.485047 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.484965    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.485047 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.485012    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7wxl\" (UniqueName: \"kubernetes.io/projected/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-kube-api-access-f7wxl\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.485287 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.485122    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.485784 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.485752    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.487323 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.487303    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.507985 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.507958    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7wxl\" (UniqueName: \"kubernetes.io/projected/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-kube-api-access-f7wxl\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.561263 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.561239    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:45:58.639823 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.639795    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:45:58.941170 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:45:58.941142    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ed8696_d7e9_4eb4_afb3_efbaee4c3c08.slice/crio-5d60723ef83434263c680a935d5a6c7aa7cf6497035d647a27adba3bb6a1ba80 WatchSource:0}: Error finding container 5d60723ef83434263c680a935d5a6c7aa7cf6497035d647a27adba3bb6a1ba80: Status 404 returned error can't find the container with id 5d60723ef83434263c680a935d5a6c7aa7cf6497035d647a27adba3bb6a1ba80
Oct 30 16:45:58.941477 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:58.941452    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"]
Oct 30 16:45:59.034578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:45:59.034543    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z" event={"ID":"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08","Type":"ContainerStarted","Data":"5d60723ef83434263c680a935d5a6c7aa7cf6497035d647a27adba3bb6a1ba80"}
Oct 30 16:46:00.042190 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:00.042099    5101 generic.go:356] "Generic (PLEG): container finished" podID="d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08" containerID="aed89f18dbf5ca8ebed7561ee8b209124c1853741eef4b50e830318eaa14c742" exitCode=0
Oct 30 16:46:00.042190 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:00.042173    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z" event={"ID":"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08","Type":"ContainerDied","Data":"aed89f18dbf5ca8ebed7561ee8b209124c1853741eef4b50e830318eaa14c742"}
Oct 30 16:46:00.074872 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:00.074839    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:01.188816 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.188790    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:46:01.314930 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.314849    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-xks-ca\") pod \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") "
Oct 30 16:46:01.314930 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.314896    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-kube-api-access-f7wxl\" (UniqueName: \"kubernetes.io/projected/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-kube-api-access-f7wxl\") pod \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") "
Oct 30 16:46:01.315138 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.315013    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-openshift-ca\") pod \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\" (UID: \"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08\") "
Oct 30 16:46:01.315450 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.315417    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-openshift-ca" pod "d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08" (UID: "d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:46:01.316865 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.316845    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-xks-ca" pod "d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08" (UID: "d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:46:01.316958 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.316942    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-kube-api-access-f7wxl" pod "d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08" (UID: "d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08"). InnerVolumeSpecName "kube-api-access-f7wxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:46:01.416469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.416433    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:46:01.416469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.416462    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:46:01.416469 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.416478    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7wxl\" (UniqueName: \"kubernetes.io/projected/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08-kube-api-access-f7wxl\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:46:01.796683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:01.796654    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:02.052779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:02.052700    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z" event={"ID":"d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08","Type":"ContainerDied","Data":"5d60723ef83434263c680a935d5a6c7aa7cf6497035d647a27adba3bb6a1ba80"}
Oct 30 16:46:02.052779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:02.052731    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"
Oct 30 16:46:02.052779 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:02.052749    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d60723ef83434263c680a935d5a6c7aa7cf6497035d647a27adba3bb6a1ba80"
Oct 30 16:46:03.187849 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:03.187811    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:03.505126 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:03.505047    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:05.238281 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:05.238229    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:06.942207 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:06.942165    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:08.704247 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:08.704209    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:08.731884 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:08.731850    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"]
Oct 30 16:46:08.904571 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:08.904536    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:09.053168 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:09.053096    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:10.421708 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:10.421675    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:11.102772 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:11.102741    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:11.890733 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:11.890696    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:12.413745 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:12.413711    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:12.514204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:12.514175    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"]
Oct 30 16:46:12.527467 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:12.527436    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3bc669-d8p7z"]
Oct 30 16:46:12.558419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:12.558389    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:13.059855 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:13.059821    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:13.073811 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:13.073781    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08" path="/var/lib/kubelet/pods/d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08/volumes"
Oct 30 16:46:13.733035 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:13.732987    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv" podUID="360e4a63-3a2e-4d20-8a86-594a50181c88" containerName="payload-processing" containerID="cri-o://957c567b075ed0c19a65902b9b8b781b118428ae0d897a4dd364fb64ec2689b7" gracePeriod=25
Oct 30 16:46:19.155205 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:19.155171    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:19.302107 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:19.302077    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:19.522468 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:19.522383    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:20.292286 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:46:20.292238    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:46:20.788045 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:20.788009    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv" podUID="360e4a63-3a2e-4d20-8a86-594a50181c88" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:46:21.666271 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:21.666239    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:30.787926 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:30.787882    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv" podUID="360e4a63-3a2e-4d20-8a86-594a50181c88" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:46:34.291562 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:34.291522    5101 generic.go:356] "Generic (PLEG): container finished" podID="360e4a63-3a2e-4d20-8a86-594a50181c88" containerID="957c567b075ed0c19a65902b9b8b781b118428ae0d897a4dd364fb64ec2689b7" exitCode=0
Oct 30 16:46:34.314364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:34.292230    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv" event={"ID":"360e4a63-3a2e-4d20-8a86-594a50181c88","Type":"ContainerDied","Data":"957c567b075ed0c19a65902b9b8b781b118428ae0d897a4dd364fb64ec2689b7"}
Oct 30 16:46:34.742162 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:34.742116    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:34.849362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:34.846441    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:46:34.849362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:34.846521    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podUID="19e716a2-f834-4286-9218-0d998953696a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:46:34.932196 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:34.931856    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:46:35.039419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.037758    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/360e4a63-3a2e-4d20-8a86-594a50181c88-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/360e4a63-3a2e-4d20-8a86-594a50181c88-plugins-config-volume\") pod \"360e4a63-3a2e-4d20-8a86-594a50181c88\" (UID: \"360e4a63-3a2e-4d20-8a86-594a50181c88\") "
Oct 30 16:46:35.039419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.037851    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/360e4a63-3a2e-4d20-8a86-594a50181c88-kube-api-access-nk4xb\" (UniqueName: \"kubernetes.io/projected/360e4a63-3a2e-4d20-8a86-594a50181c88-kube-api-access-nk4xb\") pod \"360e4a63-3a2e-4d20-8a86-594a50181c88\" (UID: \"360e4a63-3a2e-4d20-8a86-594a50181c88\") "
Oct 30 16:46:35.039419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.038229    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/360e4a63-3a2e-4d20-8a86-594a50181c88-plugins-config-volume" pod "360e4a63-3a2e-4d20-8a86-594a50181c88" (UID: "360e4a63-3a2e-4d20-8a86-594a50181c88"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:46:35.040909 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.040883    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360e4a63-3a2e-4d20-8a86-594a50181c88-kube-api-access-nk4xb" pod "360e4a63-3a2e-4d20-8a86-594a50181c88" (UID: "360e4a63-3a2e-4d20-8a86-594a50181c88"). InnerVolumeSpecName "kube-api-access-nk4xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:46:35.139539 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.139505    5101 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/360e4a63-3a2e-4d20-8a86-594a50181c88-plugins-config-volume\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:46:35.139775 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.139756    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk4xb\" (UniqueName: \"kubernetes.io/projected/360e4a63-3a2e-4d20-8a86-594a50181c88-kube-api-access-nk4xb\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:46:35.302967 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.302870    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv" event={"ID":"360e4a63-3a2e-4d20-8a86-594a50181c88","Type":"ContainerDied","Data":"ef5bfc374a482920fd1fcc23b61e046d23d763e9f09230bcd9ab01dc41c1732f"}
Oct 30 16:46:35.303718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.303620    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"
Oct 30 16:46:35.303932 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.303698    5101 scope.go:122] "RemoveContainer" containerID="957c567b075ed0c19a65902b9b8b781b118428ae0d897a4dd364fb64ec2689b7"
Oct 30 16:46:35.355718 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.355684    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"]
Oct 30 16:46:35.359189 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:35.359159    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3bc669-85f476ccczkltv"]
Oct 30 16:46:37.073219 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:37.073179    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="360e4a63-3a2e-4d20-8a86-594a50181c88" path="/var/lib/kubelet/pods/360e4a63-3a2e-4d20-8a86-594a50181c88/volumes"
Oct 30 16:46:39.669636 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:39.669602    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:40.904487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:40.904451    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:48.435275 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:46:48.435231    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:46:50.294092 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:46:50.294052    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:47:20.291005 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:47:20.290958    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:47:31.619403 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:47:31.619285    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:47:34.627010 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:47:34.626981    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:47:50.291154 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:47:50.291115    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:48:20.290307 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:48:20.290268    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:48:34.750310 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:34.750272    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:38.733641 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:38.733605    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:39.975440 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:39.975405    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:42.852778 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:42.852740    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:43.090967 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:43.090917    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:44.269952 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.269911    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:44.435907 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.435872    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:44.601725 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.601636    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:44.743192 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.743162    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"]
Oct 30 16:48:44.743928 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.743905    5101 cpu_manager.go:414] "containerMap: removing container" podUID="d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08" containerName="revoke-keys"
Oct 30 16:48:44.744010 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.743932    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08" containerName="revoke-keys"
Oct 30 16:48:44.744010 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.743962    5101 cpu_manager.go:414] "containerMap: removing container" podUID="360e4a63-3a2e-4d20-8a86-594a50181c88" containerName="payload-processing"
Oct 30 16:48:44.744010 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.743970    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="360e4a63-3a2e-4d20-8a86-594a50181c88" containerName="payload-processing"
Oct 30 16:48:44.744122 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.744110    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="d1ed8696-d7e9-4eb4-afb3-efbaee4c3c08" containerName="revoke-keys"
Oct 30 16:48:44.744157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.744129    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="360e4a63-3a2e-4d20-8a86-594a50181c88" containerName="payload-processing"
Oct 30 16:48:44.748009 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.747981    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:44.769046 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.769016    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"]
Oct 30 16:48:44.776100 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.776069    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-3060bb\""
Oct 30 16:48:44.776100 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.776096    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-f6c91d3c-dockercfg-29q27\""
Oct 30 16:48:44.835383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.835327    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r\" (UID: \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:44.835544 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.835510    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8cn6\" (UniqueName: \"kubernetes.io/projected/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-kube-api-access-m8cn6\") pod \"payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r\" (UID: \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:44.936419 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.936386    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r\" (UID: \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:44.936587 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.936506    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8cn6\" (UniqueName: \"kubernetes.io/projected/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-kube-api-access-m8cn6\") pod \"payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r\" (UID: \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:44.937102 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.937081    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r\" (UID: \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:44.962180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:44.962149    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8cn6\" (UniqueName: \"kubernetes.io/projected/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-kube-api-access-m8cn6\") pod \"payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r\" (UID: \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:45.067860 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:45.067827    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:45.368217 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:45.368181    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"]
Oct 30 16:48:45.369069 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:48:45.369045    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18bdcf5_9f0f_4729_b2c6_dde5a71db78f.slice/crio-385a8200484f451567a56f085f3471bf7d5f561f25432a8301d545476808719d WatchSource:0}: Error finding container 385a8200484f451567a56f085f3471bf7d5f561f25432a8301d545476808719d: Status 404 returned error can't find the container with id 385a8200484f451567a56f085f3471bf7d5f561f25432a8301d545476808719d
Oct 30 16:48:45.992877 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:45.992845    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r" event={"ID":"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f","Type":"ContainerStarted","Data":"f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6"}
Oct 30 16:48:45.993064 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:45.992902    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r" event={"ID":"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f","Type":"ContainerStarted","Data":"385a8200484f451567a56f085f3471bf7d5f561f25432a8301d545476808719d"}
Oct 30 16:48:45.993064 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:45.992950    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:46.034821 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:46.034773    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r" podStartSLOduration=2.034756309 podStartE2EDuration="2.034756309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:48:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:48:46.032891388 +0000 UTC m=+1745.086168997" watchObservedRunningTime="2026-10-30 16:48:46.034756309 +0000 UTC m=+1745.088033919"
Oct 30 16:48:46.176221 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:46.176175    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:47.717030 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:47.716991    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:49.313071 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:49.313028    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:50.293981 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:48:50.293940    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:48:50.942702 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:50.942645    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:52.593438 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:52.593404    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:54.242879 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:54.242782    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:55.960251 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:55.960217    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:57.002364 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:57.002324    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:48:57.691917 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:57.691883    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:57.839863 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:57.839829    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:58.415684 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:58.415648    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:58.564230 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:58.564202    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:58.706055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:58.705963    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:48:59.291839 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:48:59.291800    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:00.419321 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:00.419277    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:01.008903 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:01.008864    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:01.463357 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:01.463310    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:02.802881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:02.802850    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:04.650300 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:04.650259    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:06.132525 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:06.132484    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:07.678842 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:07.678803    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:09.259473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:09.259442    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:10.886945 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:10.886911    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:12.475614 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:12.475549    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:13.986335 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:13.986301    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:15.689844 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:15.689810    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:17.307816 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:17.307731    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:18.995747 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:18.995706    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:19.531213 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.531179    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"]
Oct 30 16:49:19.535067 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.535050    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.552514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.552488    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:49:19.564534 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.564498    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:49:19.566751 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.566729    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"]
Oct 30 16:49:19.592506 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.592483    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.592633 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.592540    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.592699 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.592650    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29bvv\" (UniqueName: \"kubernetes.io/projected/0077eb42-f2ae-4f19-be5b-adc8bea26998-kube-api-access-29bvv\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.693642 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.693610    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.693810 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.693657    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29bvv\" (UniqueName: \"kubernetes.io/projected/0077eb42-f2ae-4f19-be5b-adc8bea26998-kube-api-access-29bvv\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.693810 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.693739    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.694403 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.694379    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.696028 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.696007    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.716830 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.716806    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29bvv\" (UniqueName: \"kubernetes.io/projected/0077eb42-f2ae-4f19-be5b-adc8bea26998-kube-api-access-29bvv\") pod \"maas-api-revoke-sub-c338f385-qj4qn\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:19.848246 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:19.848167    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:20.146188 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:49:20.146157    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0077eb42_f2ae_4f19_be5b_adc8bea26998.slice/crio-5fa8e5b47ee60487ece0b89a88dc698fc38619dc224fda13c6b3d7f6d75699fa WatchSource:0}: Error finding container 5fa8e5b47ee60487ece0b89a88dc698fc38619dc224fda13c6b3d7f6d75699fa: Status 404 returned error can't find the container with id 5fa8e5b47ee60487ece0b89a88dc698fc38619dc224fda13c6b3d7f6d75699fa
Oct 30 16:49:20.146921 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:20.146895    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"]
Oct 30 16:49:20.165519 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:20.165491    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn" event={"ID":"0077eb42-f2ae-4f19-be5b-adc8bea26998","Type":"ContainerStarted","Data":"5fa8e5b47ee60487ece0b89a88dc698fc38619dc224fda13c6b3d7f6d75699fa"}
Oct 30 16:49:20.289784 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:49:20.289752    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:49:20.580440 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:20.580407    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:21.172763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:21.172724    5101 generic.go:356] "Generic (PLEG): container finished" podID="0077eb42-f2ae-4f19-be5b-adc8bea26998" containerID="6f4dfb3a2c14f6f124a8362c42651d91494a43e42501aab9dca9b280a8470a45" exitCode=0
Oct 30 16:49:21.173139 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:21.172791    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn" event={"ID":"0077eb42-f2ae-4f19-be5b-adc8bea26998","Type":"ContainerDied","Data":"6f4dfb3a2c14f6f124a8362c42651d91494a43e42501aab9dca9b280a8470a45"}
Oct 30 16:49:22.160744 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.160705    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:22.309888 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.309862    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:22.421683 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.421609    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0077eb42-f2ae-4f19-be5b-adc8bea26998-kube-api-access-29bvv\" (UniqueName: \"kubernetes.io/projected/0077eb42-f2ae-4f19-be5b-adc8bea26998-kube-api-access-29bvv\") pod \"0077eb42-f2ae-4f19-be5b-adc8bea26998\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") "
Oct 30 16:49:22.421828 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.421717    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-xks-ca\") pod \"0077eb42-f2ae-4f19-be5b-adc8bea26998\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") "
Oct 30 16:49:22.421828 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.421781    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-openshift-ca\") pod \"0077eb42-f2ae-4f19-be5b-adc8bea26998\" (UID: \"0077eb42-f2ae-4f19-be5b-adc8bea26998\") "
Oct 30 16:49:22.422181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.422154    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-openshift-ca" pod "0077eb42-f2ae-4f19-be5b-adc8bea26998" (UID: "0077eb42-f2ae-4f19-be5b-adc8bea26998"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:49:22.423767 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.423742    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-xks-ca" pod "0077eb42-f2ae-4f19-be5b-adc8bea26998" (UID: "0077eb42-f2ae-4f19-be5b-adc8bea26998"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:49:22.423915 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.423892    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0077eb42-f2ae-4f19-be5b-adc8bea26998-kube-api-access-29bvv" pod "0077eb42-f2ae-4f19-be5b-adc8bea26998" (UID: "0077eb42-f2ae-4f19-be5b-adc8bea26998"). InnerVolumeSpecName "kube-api-access-29bvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:49:22.522579 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.522544    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29bvv\" (UniqueName: \"kubernetes.io/projected/0077eb42-f2ae-4f19-be5b-adc8bea26998-kube-api-access-29bvv\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:49:22.522579 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.522574    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:49:22.522579 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:22.522584    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0077eb42-f2ae-4f19-be5b-adc8bea26998-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:49:23.184202 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:23.184175    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"
Oct 30 16:49:23.184375 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:23.184217    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn" event={"ID":"0077eb42-f2ae-4f19-be5b-adc8bea26998","Type":"ContainerDied","Data":"5fa8e5b47ee60487ece0b89a88dc698fc38619dc224fda13c6b3d7f6d75699fa"}
Oct 30 16:49:23.184375 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:23.184263    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fa8e5b47ee60487ece0b89a88dc698fc38619dc224fda13c6b3d7f6d75699fa"
Oct 30 16:49:23.661174 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:23.661133    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:25.252182 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:25.252143    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:26.726913 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:26.726879    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:28.254901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:28.254859    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:29.810498 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:29.810459    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:30.406022 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.405991    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:30.541956 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.541919    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"]
Oct 30 16:49:30.542487 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.542467    5101 cpu_manager.go:414] "containerMap: removing container" podUID="0077eb42-f2ae-4f19-be5b-adc8bea26998" containerName="revoke-keys"
Oct 30 16:49:30.542600 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.542488    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0077eb42-f2ae-4f19-be5b-adc8bea26998" containerName="revoke-keys"
Oct 30 16:49:30.542655 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.542626    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="0077eb42-f2ae-4f19-be5b-adc8bea26998" containerName="revoke-keys"
Oct 30 16:49:30.545872 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.545852    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.571748 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.571715    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"]
Oct 30 16:49:30.575020 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.574994    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:49:30.575157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.575119    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:49:30.705914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.705819    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.705914 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.705883    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.706111 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.706010    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnxx2\" (UniqueName: \"kubernetes.io/projected/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-kube-api-access-bnxx2\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.806837 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.806797    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxx2\" (UniqueName: \"kubernetes.io/projected/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-kube-api-access-bnxx2\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.807051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.806885    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.807051 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.806917    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.807561 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.807539    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.809326 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.809302    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.830559 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.830537    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnxx2\" (UniqueName: \"kubernetes.io/projected/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-kube-api-access-bnxx2\") pod \"maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:30.859473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:30.859446    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:31.161020 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:31.160980    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"]
Oct 30 16:49:31.161216 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:49:31.161192    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0028df80_4fa9_48d2_b5f5_49f521bf6bf8.slice/crio-8f3fdaf04cd6688823ac8d7db38fc961a524c17272ce7d0f74f1039b1bc65dbf WatchSource:0}: Error finding container 8f3fdaf04cd6688823ac8d7db38fc961a524c17272ce7d0f74f1039b1bc65dbf: Status 404 returned error can't find the container with id 8f3fdaf04cd6688823ac8d7db38fc961a524c17272ce7d0f74f1039b1bc65dbf
Oct 30 16:49:31.227231 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:31.227194    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n" event={"ID":"0028df80-4fa9-48d2-b5f5-49f521bf6bf8","Type":"ContainerStarted","Data":"8f3fdaf04cd6688823ac8d7db38fc961a524c17272ce7d0f74f1039b1bc65dbf"}
Oct 30 16:49:31.366383 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:31.366332    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:32.233446 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:32.233414    5101 generic.go:356] "Generic (PLEG): container finished" podID="0028df80-4fa9-48d2-b5f5-49f521bf6bf8" containerID="03762235e6fb3d52e7b6ecb17ee806d02f2ed944a53f8a999cd73e17b9d081cd" exitCode=0
Oct 30 16:49:32.233835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:32.233493    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n" event={"ID":"0028df80-4fa9-48d2-b5f5-49f521bf6bf8","Type":"ContainerDied","Data":"03762235e6fb3d52e7b6ecb17ee806d02f2ed944a53f8a999cd73e17b9d081cd"}
Oct 30 16:49:32.978242 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:32.978208    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:33.393286 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.393260    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:33.532578 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.532497    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-openshift-ca\") pod \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") "
Oct 30 16:49:33.532741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.532629    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-xks-ca\") pod \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") "
Oct 30 16:49:33.532741 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.532682    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-kube-api-access-bnxx2\" (UniqueName: \"kubernetes.io/projected/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-kube-api-access-bnxx2\") pod \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\" (UID: \"0028df80-4fa9-48d2-b5f5-49f521bf6bf8\") "
Oct 30 16:49:33.532901 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.532880    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-openshift-ca" pod "0028df80-4fa9-48d2-b5f5-49f521bf6bf8" (UID: "0028df80-4fa9-48d2-b5f5-49f521bf6bf8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:49:33.533057 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.533042    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-openshift-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:49:33.534724 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.534699    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-xks-ca" pod "0028df80-4fa9-48d2-b5f5-49f521bf6bf8" (UID: "0028df80-4fa9-48d2-b5f5-49f521bf6bf8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:49:33.534852 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.534787    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-kube-api-access-bnxx2" pod "0028df80-4fa9-48d2-b5f5-49f521bf6bf8" (UID: "0028df80-4fa9-48d2-b5f5-49f521bf6bf8"). InnerVolumeSpecName "kube-api-access-bnxx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:49:33.634531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.634502    5101 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-maas-api-xks-ca\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:49:33.634531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:33.634525    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnxx2\" (UniqueName: \"kubernetes.io/projected/0028df80-4fa9-48d2-b5f5-49f521bf6bf8-kube-api-access-bnxx2\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:49:34.244307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:34.244220    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"
Oct 30 16:49:34.244307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:34.244229    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n" event={"ID":"0028df80-4fa9-48d2-b5f5-49f521bf6bf8","Type":"ContainerDied","Data":"8f3fdaf04cd6688823ac8d7db38fc961a524c17272ce7d0f74f1039b1bc65dbf"}
Oct 30 16:49:34.244307 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:34.244273    5101 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f3fdaf04cd6688823ac8d7db38fc961a524c17272ce7d0f74f1039b1bc65dbf"
Oct 30 16:49:34.702486 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:34.702442    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:34.864399 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:34.864355    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:35.532314 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:35.532227    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:36.281830 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:36.281800    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:37.774287 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:37.774245    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:39.491203 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:39.491162    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:40.942365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:40.942310    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"]
Oct 30 16:49:41.079295 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:41.078718    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:41.223889 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:41.223805    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:41.316674 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:41.316648    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:49:41.320055 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:41.320028    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:49:41.324127 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:41.324101    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:49:41.327427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:41.327410    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:49:42.449496 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:42.449461    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:42.952180 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:42.952117    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:43.062119 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:43.062081    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"]
Oct 30 16:49:43.074048 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:43.074018    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3060bb-vzr8n"]
Oct 30 16:49:43.103661 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:43.103626    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:43.612463 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:43.612430    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:45.073839 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:45.073796    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0028df80-4fa9-48d2-b5f5-49f521bf6bf8" path="/var/lib/kubelet/pods/0028df80-4fa9-48d2-b5f5-49f521bf6bf8/volumes"
Oct 30 16:49:45.943391 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:45.943313    5101 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r" podUID="e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" containerName="payload-processing" containerID="cri-o://f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6" gracePeriod=25
Oct 30 16:49:47.001462 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:47.001426    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r" podUID="e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:49:49.772291 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:49.772255    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:49.943514 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:49.943483    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:50.129231 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:50.129134    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:50.292069 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:49:50.292031    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:49:54.507952 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:54.507917    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:49:57.000734 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:49:57.000697    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r" podUID="e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 16:50:03.616545 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:03.616491    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:50:03.977878 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:03.977846    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:50:06.195231 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.195206    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:50:06.296528 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.296445    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-kube-api-access-m8cn6\" (UniqueName: \"kubernetes.io/projected/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-kube-api-access-m8cn6\") pod \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\" (UID: \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\") "
Oct 30 16:50:06.296685 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.296572    5101 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-plugins-config-volume\") pod \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\" (UID: \"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f\") "
Oct 30 16:50:06.296946 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.296923    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-plugins-config-volume" pod "e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" (UID: "e18bdcf5-9f0f-4729-b2c6-dde5a71db78f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:50:06.298482 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.298457    5101 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-kube-api-access-m8cn6" pod "e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" (UID: "e18bdcf5-9f0f-4729-b2c6-dde5a71db78f"). InnerVolumeSpecName "kube-api-access-m8cn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:50:06.398139 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.398105    5101 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-plugins-config-volume\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:50:06.398139 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.398133    5101 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8cn6\" (UniqueName: \"kubernetes.io/projected/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f-kube-api-access-m8cn6\") on node \"ip-10-0-138-40.ec2.internal\" DevicePath \"\""
Oct 30 16:50:06.466638 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.466602    5101 generic.go:356] "Generic (PLEG): container finished" podID="e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" containerID="f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6" exitCode=0
Oct 30 16:50:06.466813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.466651    5101 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"
Oct 30 16:50:06.466813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.466690    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r" event={"ID":"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f","Type":"ContainerDied","Data":"f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6"}
Oct 30 16:50:06.466813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.466751    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r" event={"ID":"e18bdcf5-9f0f-4729-b2c6-dde5a71db78f","Type":"ContainerDied","Data":"385a8200484f451567a56f085f3471bf7d5f561f25432a8301d545476808719d"}
Oct 30 16:50:06.466813 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.466776    5101 scope.go:122] "RemoveContainer" containerID="f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6"
Oct 30 16:50:06.476427 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.476410    5101 scope.go:122] "RemoveContainer" containerID="f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6"
Oct 30 16:50:06.476697 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:50:06.476679    5101 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6\": container with ID starting with f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6 not found: ID does not exist" containerID="f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6"
Oct 30 16:50:06.476735 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.476706    5101 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6"} err="failed to get container status \"f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6\": rpc error: code = NotFound desc = could not find container \"f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6\": container with ID starting with f4ca63981371ce71c4d6be8b8017493db9922cadfaacf4f35ed16e083cead1c6 not found: ID does not exist"
Oct 30 16:50:06.517994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.517969    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"]
Oct 30 16:50:06.529958 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:06.529934    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-3060bb-577f554c4tnz6r"]
Oct 30 16:50:07.074064 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:07.074029    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" path="/var/lib/kubelet/pods/e18bdcf5-9f0f-4729-b2c6-dde5a71db78f/volumes"
Oct 30 16:50:09.666738 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:09.666701    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:50:16.482695 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:16.482631    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:50:20.304205 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:50:20.304166    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:50:22.169875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:22.169449    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:50:22.169875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:22.169529    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podUID="9d0c1cd2-06b6-4489-a509-cfb3ec71debc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:50:34.991531 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:34.991493    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:50:46.662720 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:46.662687    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:50:50.306792 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:50:50.306744    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:50:50.994474 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:50.994412    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:50:51.188365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:51.172839    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"]
Oct 30 16:50:51.188365 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:51.172890    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-48aa8440-nnw9h"]
Oct 30 16:50:52.146362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:52.145489    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:50:52.146362 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:52.145560    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq" podUID="9d0c1cd2-06b6-4489-a509-cfb3ec71debc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:50:52.604438 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:52.604313    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:50:53.072841 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:53.072804    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8460cd02-1de3-4b2b-947d-8de48f7f6648" path="/var/lib/kubelet/pods/8460cd02-1de3-4b2b-947d-8de48f7f6648/volumes"
Oct 30 16:50:54.639224 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:50:54.639180    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:51:16.070916 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:16.070884    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:51:16.234727 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:16.234696    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:51:20.290864 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:51:20.290832    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:51:35.127396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:35.127330    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:51:38.803635 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.803598    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-d59tw"]
Oct 30 16:51:38.804081 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.804068    5101 cpu_manager.go:414] "containerMap: removing container" podUID="e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" containerName="payload-processing"
Oct 30 16:51:38.804125 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.804081    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" containerName="payload-processing"
Oct 30 16:51:38.804125 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.804108    5101 cpu_manager.go:414] "containerMap: removing container" podUID="0028df80-4fa9-48d2-b5f5-49f521bf6bf8" containerName="revoke-keys"
Oct 30 16:51:38.804125 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.804113    5101 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0028df80-4fa9-48d2-b5f5-49f521bf6bf8" containerName="revoke-keys"
Oct 30 16:51:38.804215 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.804192    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="e18bdcf5-9f0f-4729-b2c6-dde5a71db78f" containerName="payload-processing"
Oct 30 16:51:38.804215 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.804205    5101 memory_manager.go:365] "RemoveStaleState removing state" podUID="0028df80-4fa9-48d2-b5f5-49f521bf6bf8" containerName="revoke-keys"
Oct 30 16:51:38.807388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.807373    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:38.837310 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.837288    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dqwfr\""
Oct 30 16:51:38.837521 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.837504    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 16:51:38.837591 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.837502    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 16:51:38.841599 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.841577    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-d59tw"]
Oct 30 16:51:38.908208 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.908162    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-metrics-certs\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:38.908426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.908253    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-maas-api-tls\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:38.908426 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.908324    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-openshift-service-ca\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:38.908507 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:38.908458    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24dld\" (UniqueName: \"kubernetes.io/projected/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-kube-api-access-24dld\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.009258 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.009221    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24dld\" (UniqueName: \"kubernetes.io/projected/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-kube-api-access-24dld\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.009473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.009301    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-metrics-certs\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.009473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.009320    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-maas-api-tls\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.009473 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.009396    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-openshift-service-ca\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.010154 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.010132    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-openshift-service-ca\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.011765 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.011739    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-metrics-certs\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.011910 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.011889    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-maas-api-tls\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.032869 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.032843    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24dld\" (UniqueName: \"kubernetes.io/projected/d9bfcd0d-e768-41b6-9699-184ac5e55dcc-kube-api-access-24dld\") pod \"maas-api-595cc648c-d59tw\" (UID: \"d9bfcd0d-e768-41b6-9699-184ac5e55dcc\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.120374 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.120292    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:39.427379 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.427335    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-d59tw"]
Oct 30 16:51:39.427514 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:51:39.427411    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bfcd0d_e768_41b6_9699_184ac5e55dcc.slice/crio-b1de2cd6baa9d24de965aa0e8c6e8b2b0348a6d52c447aa3ef42a6dff2661ec5 WatchSource:0}: Error finding container b1de2cd6baa9d24de965aa0e8c6e8b2b0348a6d52c447aa3ef42a6dff2661ec5: Status 404 returned error can't find the container with id b1de2cd6baa9d24de965aa0e8c6e8b2b0348a6d52c447aa3ef42a6dff2661ec5
Oct 30 16:51:39.428726 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:39.428709    5101 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:51:40.217530 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:40.217484    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw" event={"ID":"d9bfcd0d-e768-41b6-9699-184ac5e55dcc","Type":"ContainerStarted","Data":"18c586e4ec56ee1f57391d9c0fee9b2eac1a972d1b382e601acec38516572339"}
Oct 30 16:51:40.218073 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:40.217554    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw" event={"ID":"d9bfcd0d-e768-41b6-9699-184ac5e55dcc","Type":"ContainerStarted","Data":"b1de2cd6baa9d24de965aa0e8c6e8b2b0348a6d52c447aa3ef42a6dff2661ec5"}
Oct 30 16:51:40.218073 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:40.217601    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:40.272413 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:40.272330    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw" podStartSLOduration=1.920368217 podStartE2EDuration="2.27231119s" totalImagesPullingTime="351.942973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:51:40.269919476 +0000 UTC m=+1919.323197112" watchObservedRunningTime="2026-10-30 16:51:40.27231119 +0000 UTC m=+1919.325588800"
Oct 30 16:51:46.247181 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:46.247150    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-d59tw"
Oct 30 16:51:49.818363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:49.817456    5101 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:51:49.818363 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:51:49.817563    5101 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk" podUID="19e716a2-f834-4286-9218-0d998953696a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:51:50.407469 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:51:50.406539    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:52:20.291263 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:52:20.291183    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:52:35.246050 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:35.246012    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:52:41.849859 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:41.849826    5101 scope.go:122] "RemoveContainer" containerID="561aa1549fa9c230b004a68c0c6aae7734f0ee40f27c36cf71167f15bbda31c8"
Oct 30 16:52:41.861090 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:41.861069    5101 scope.go:122] "RemoveContainer" containerID="aed89f18dbf5ca8ebed7561ee8b209124c1853741eef4b50e830318eaa14c742"
Oct 30 16:52:49.467617 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:49.467585    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-k9cjs_da7fbd30-e3e6-40a9-af14-b85ecf366d22/manager/0.log"
Oct 30 16:52:49.672993 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:49.672961    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-5cfb77bf8c-7gcfx_e2bfb1be-3e8d-465b-aa2e-72b09dd25769/manager/0.log"
Oct 30 16:52:50.290566 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:52:50.290529    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:52:50.471169 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:50.471133    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-tth4z_3a6aeb34-902a-4c3e-b276-01b9a329fab9/server/0.log"
Oct 30 16:52:50.667752 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:50.667726    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-l7pr2_3f125229-9356-4897-99e3-3271fe7067eb/manager/0.log"
Oct 30 16:52:50.887187 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:50.887146    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-observability-584f99c788-ns26f_cac2e745-b65e-4bce-965d-e673223ee10a/manager/0.log"
Oct 30 16:52:51.651014 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:51.650986    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8dcb75f99-z6bt4_397f5512-9211-4179-94d9-41964e7decd8/copy-manifests/0.log"
Oct 30 16:52:51.680105 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:51.680085    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8dcb75f99-z6bt4_397f5512-9211-4179-94d9-41964e7decd8/manager/0.log"
Oct 30 16:52:51.879747 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:51.879717    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-p8rlm_890b31e3-1a31-4273-aa31-3be7b6adf0a8/proxy/0.log"
Oct 30 16:52:52.694233 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:52.694207    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-d59tw_d9bfcd0d-e768-41b6-9699-184ac5e55dcc/maas-api/0.log"
Oct 30 16:52:54.075124 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:54.075079    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-c338f385-qj4qn_0077eb42-f2ae-4f19-be5b-adc8bea26998/revoke-keys/0.log"
Oct 30 16:52:54.850892 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:54.850864    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-q28lc_0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a/postgres/0.log"
Oct 30 16:52:57.094853 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:57.094825    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-wb4sl_e5778148-43bf-4e27-8b3a-968348a81718/kuadrant-console-plugin/0.log"
Oct 30 16:52:59.448231 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:59.448189    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f_6369c3b2-2ff1-454a-ba33-237e8a131bc3/istio-proxy/0.log"
Oct 30 16:52:59.670173 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:52:59.670145    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq_9d0c1cd2-06b6-4489-a509-cfb3ec71debc/istio-proxy/0.log"
Oct 30 16:53:00.485631 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:00.485594    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk_19e716a2-f834-4286-9218-0d998953696a/istio-proxy/0.log"
Oct 30 16:53:00.685279 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:00.685247    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj_980dadce-85e0-4130-898d-9836658982ea/istio-proxy/0.log"
Oct 30 16:53:01.921814 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:01.921787    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9f769b7d5-g6vn9_fcb660ae-8c6a-42ec-bd90-484b9497250b/router/0.log"
Oct 30 16:53:02.980157 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:02.980124    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds_f95fa666-ca94-4394-9f21-22d210546af0/main/0.log"
Oct 30 16:53:03.178887 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:03.178860    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-r4xpf_dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3/main/0.log"
Oct 30 16:53:03.371994 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:03.371919    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-76mjt_8d0a71c1-e789-4407-89b5-7b3ed6ea114f/main/0.log"
Oct 30 16:53:03.584897 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:03.584855    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-c4jq5_fe052556-7fdf-4027-840b-95572d395bff/main/0.log"
Oct 30 16:53:03.775573 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:03.775545    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx_d2255246-1390-46f8-959c-2d3e3ecae1d3/main/0.log"
Oct 30 16:53:14.989091 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:14.989057    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-k9cjs_da7fbd30-e3e6-40a9-af14-b85ecf366d22/manager/0.log"
Oct 30 16:53:15.194007 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:15.193965    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-5cfb77bf8c-7gcfx_e2bfb1be-3e8d-465b-aa2e-72b09dd25769/manager/0.log"
Oct 30 16:53:15.888792 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:15.888764    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-tth4z_3a6aeb34-902a-4c3e-b276-01b9a329fab9/server/0.log"
Oct 30 16:53:16.091728 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:16.091700    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-l7pr2_3f125229-9356-4897-99e3-3271fe7067eb/manager/0.log"
Oct 30 16:53:16.310062 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:16.310032    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-observability-584f99c788-ns26f_cac2e745-b65e-4bce-965d-e673223ee10a/manager/0.log"
Oct 30 16:53:17.059436 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:17.059409    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8dcb75f99-z6bt4_397f5512-9211-4179-94d9-41964e7decd8/copy-manifests/0.log"
Oct 30 16:53:17.089213 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:17.089190    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8dcb75f99-z6bt4_397f5512-9211-4179-94d9-41964e7decd8/manager/0.log"
Oct 30 16:53:17.285479 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:17.285440    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-p8rlm_890b31e3-1a31-4273-aa31-3be7b6adf0a8/proxy/0.log"
Oct 30 16:53:17.835735 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:17.835705    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-d59tw_d9bfcd0d-e768-41b6-9699-184ac5e55dcc/maas-api/0.log"
Oct 30 16:53:19.206204 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:19.206178    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-c338f385-qj4qn_0077eb42-f2ae-4f19-be5b-adc8bea26998/revoke-keys/0.log"
Oct 30 16:53:19.784835 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:19.784807    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-q28lc_0a8787b4-3cc8-4cfd-80e5-c8f08b60ed1a/postgres/0.log"
Oct 30 16:53:20.291539 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:53:20.291505    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:53:21.641328 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:21.641300    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-wb4sl_e5778148-43bf-4e27-8b3a-968348a81718/kuadrant-console-plugin/0.log"
Oct 30 16:53:23.782811 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:23.782729    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f_6369c3b2-2ff1-454a-ba33-237e8a131bc3/istio-proxy/0.log"
Oct 30 16:53:23.994786 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:23.994730    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq_9d0c1cd2-06b6-4489-a509-cfb3ec71debc/istio-proxy/0.log"
Oct 30 16:53:24.844713 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:24.844669    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk_19e716a2-f834-4286-9218-0d998953696a/istio-proxy/0.log"
Oct 30 16:53:25.063977 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:25.063948    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj_980dadce-85e0-4130-898d-9836658982ea/istio-proxy/0.log"
Oct 30 16:53:26.295086 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:26.295052    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9f769b7d5-g6vn9_fcb660ae-8c6a-42ec-bd90-484b9497250b/router/0.log"
Oct 30 16:53:26.857408 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:26.857367    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-xbvds_f95fa666-ca94-4394-9f21-22d210546af0/main/0.log"
Oct 30 16:53:27.061981 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:27.061953    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-r4xpf_dbb79bf8-16b2-4030-abbb-c3c4c9fc62a3/main/0.log"
Oct 30 16:53:27.258712 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:27.258662    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-76mjt_8d0a71c1-e789-4407-89b5-7b3ed6ea114f/main/0.log"
Oct 30 16:53:27.464672 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:27.464639    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-c4jq5_fe052556-7fdf-4027-840b-95572d395bff/main/0.log"
Oct 30 16:53:27.666517 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:27.666483    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dbjdx_d2255246-1390-46f8-959c-2d3e3ecae1d3/main/0.log"
Oct 30 16:53:35.385919 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:53:35.385889    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:53:50.292441 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:53:50.292397    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:54:20.291258 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:54:20.291221    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:54:23.030298 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:23.030263    5101 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"]
Oct 30 16:54:23.041999 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:23.041968    5101 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c338f385-qj4qn"]
Oct 30 16:54:23.073284 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:23.073247    5101 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0077eb42-f2ae-4f19-be5b-adc8bea26998" path="/var/lib/kubelet/pods/0077eb42-f2ae-4f19-be5b-adc8bea26998/volumes"
Oct 30 16:54:26.160424 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:26.160384    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:54:27.691406 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:27.691375    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:54:35.498000 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:35.497964    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:54:41.349148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:41.349119    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:54:41.352621 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:41.352596    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:54:41.361411 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:41.361390    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:54:41.364875 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:41.364858    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxtgs_10e23d4f-4633-46b8-882f-3acabfb8a3f1/ovn-acl-logging/0.log"
Oct 30 16:54:50.292223 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:54:50.292188    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:54:59.109665 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:59.109580    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:54:59.285351 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:54:59.285317    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024
Oct 30 16:55:03.507815 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:03.507785    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4xnzd_fc642127-45e3-46e5-897f-93b899a68127/global-pull-secret-syncer/0.log"
Oct 30 16:55:04.105661 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:04.105635    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-95hdf_c6f74c24-d57d-4296-b70d-631bd8eac394/connection-checker/0.log"
Oct 30 16:55:04.227502 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:04.227470    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-n4sp2_17bcd7b8-e377-451f-809b-9887d5b937e2/connection-checker/0.log"
Oct 30 16:55:04.349850 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:04.349819    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-s7lhf_bf184a45-b70e-4fd6-9435-821fbeb133ba/connection-checker/0.log"
Oct 30 16:55:04.490130 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:04.490098    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log"
Oct 30 16:55:05.205236 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:05.205204    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-40.ec2.internal_5516ee241b7eda607841dfd15963de2b/haproxy/0.log"
Oct 30 16:55:11.072864 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:11.072834    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-wb4sl_e5778148-43bf-4e27-8b3a-968348a81718/kuadrant-console-plugin/0.log"
Oct 30 16:55:13.431918 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.431881    5101 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"]
Oct 30 16:55:13.435666 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.435648    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.455464 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.455439    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"]
Oct 30 16:55:13.465888 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.465852    5101 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dcxv9\"/\"default-dockercfg-sj5n4\""
Oct 30 16:55:13.466016 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.465940    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dcxv9\"/\"openshift-service-ca.crt\""
Oct 30 16:55:13.466084 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.466037    5101 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dcxv9\"/\"kube-root-ca.crt\""
Oct 30 16:55:13.502009 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.501978    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-lib-modules\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.502140 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.502016    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-sys\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.502238 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.502217    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-proc\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.502285 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.502254    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znfw2\" (UniqueName: \"kubernetes.io/projected/ac400e5e-252e-4e91-8d89-76503e4bae73-kube-api-access-znfw2\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.502370 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.502323    5101 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-podres\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.603713 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603677    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-proc\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.603899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603719    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znfw2\" (UniqueName: \"kubernetes.io/projected/ac400e5e-252e-4e91-8d89-76503e4bae73-kube-api-access-znfw2\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.603899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603744    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-podres\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.603899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603784    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-lib-modules\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.603899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603800    5101 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-sys\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.603899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603808    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-proc\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.603899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603875    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-sys\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.603899 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603904    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-lib-modules\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.604194 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.603905    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac400e5e-252e-4e91-8d89-76503e4bae73-podres\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.627193 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.627166    5101 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znfw2\" (UniqueName: \"kubernetes.io/projected/ac400e5e-252e-4e91-8d89-76503e4bae73-kube-api-access-znfw2\") pod \"perf-node-gather-daemonset-gg6gc\" (UID: \"ac400e5e-252e-4e91-8d89-76503e4bae73\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.748329 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.748254    5101 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:13.856763 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:13.856738    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-5knxh_41c538db-7de5-4e4d-ba29-d329164990cd/cluster-monitoring-operator/0.log"
Oct 30 16:55:14.049442 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:14.049414    5101 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"]
Oct 30 16:55:14.050837 ip-10-0-138-40 kubenswrapper[5101]: W1030 16:55:14.050796    5101 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac400e5e_252e_4e91_8d89_76503e4bae73.slice/crio-0f49a797fb1eba46b9695b1ba49887993390560bb6b4d3d17f5aa36ac439f23b WatchSource:0}: Error finding container 0f49a797fb1eba46b9695b1ba49887993390560bb6b4d3d17f5aa36ac439f23b: Status 404 returned error can't find the container with id 0f49a797fb1eba46b9695b1ba49887993390560bb6b4d3d17f5aa36ac439f23b
Oct 30 16:55:14.421755 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:14.421720    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc" event={"ID":"ac400e5e-252e-4e91-8d89-76503e4bae73","Type":"ContainerStarted","Data":"d073cb0ac0e6104a73e74a72827a3a67624653ce09ee227e29b48076542310b7"}
Oct 30 16:55:14.421958 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:14.421770    5101 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc" event={"ID":"ac400e5e-252e-4e91-8d89-76503e4bae73","Type":"ContainerStarted","Data":"0f49a797fb1eba46b9695b1ba49887993390560bb6b4d3d17f5aa36ac439f23b"}
Oct 30 16:55:14.421958 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:14.421847    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:14.463911 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:14.463863    5101 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc" podStartSLOduration=1.463850458 podStartE2EDuration="1.463850458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:55:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:55:14.463166197 +0000 UTC m=+2133.516443809" watchObservedRunningTime="2026-10-30 16:55:14.463850458 +0000 UTC m=+2133.517128100"
Oct 30 16:55:15.318195 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:15.318167    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x72vf_0809b322-bdca-402c-ac9a-6f3fc3a8a760/node-exporter/0.log"
Oct 30 16:55:15.529545 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:15.529514    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x72vf_0809b322-bdca-402c-ac9a-6f3fc3a8a760/kube-rbac-proxy/0.log"
Oct 30 16:55:15.644758 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:15.644732    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x72vf_0809b322-bdca-402c-ac9a-6f3fc3a8a760/init-textfile/0.log"
Oct 30 16:55:16.960396 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:16.960361    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-m46tl_9fbd12a1-795c-4c0e-b286-dd3799a0f9c4/prometheus-operator/0.log"
Oct 30 16:55:17.070893 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:17.070862    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-m46tl_9fbd12a1-795c-4c0e-b286-dd3799a0f9c4/kube-rbac-proxy/0.log"
Oct 30 16:55:17.186896 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:17.186863    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-7qx4h_3268f679-7d51-4b94-8d73-f67f8268dd23/prometheus-operator-admission-webhook/0.log"
Oct 30 16:55:19.736814 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:19.736786    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-kjxhd_9f1110bc-3087-4f49-9e1c-5371b8c85d09/networking-console-plugin/0.log"
Oct 30 16:55:20.291176 ip-10-0-138-40 kubenswrapper[5101]: E1030 16:55:20.291134    5101 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wkcqh" containerName="extractor"
Oct 30 16:55:20.437881 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:20.437851    5101 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-gg6gc"
Oct 30 16:55:20.873388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:20.873333    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/1.log"
Oct 30 16:55:20.877807 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:20.877789    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-ml6q4_d5b9aacd-cd48-4496-a43a-ce89ff7a29fa/console-operator/2.log"
Oct 30 16:55:22.281868 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:22.281841    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-9rfh6_d5784056-c325-4d6b-afaf-f4f299436097/download-server/0.log"
Oct 30 16:55:23.531941 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:23.531910    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-gczng_52e59496-41f2-430d-8c96-467b3ef3a839/volume-data-source-validator/0.log"
Oct 30 16:55:26.181388 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:26.181319    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l8nf9_30f743ff-35c0-42c8-9ab1-422606471aa0/dns/0.log"
Oct 30 16:55:26.293249 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:26.293224    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l8nf9_30f743ff-35c0-42c8-9ab1-422606471aa0/kube-rbac-proxy/0.log"
Oct 30 16:55:26.925332 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:26.925303    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4b9s_37d06c87-6ddd-4605-9322-9e13e26eaaa4/dns-node-resolver/0.log"
Oct 30 16:55:27.696808 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:27.696774    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-7dg9f_6369c3b2-2ff1-454a-ba33-237e8a131bc3/istio-proxy/0.log"
Oct 30 16:55:27.828441 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:27.828412    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-9hpwq_9d0c1cd2-06b6-4489-a509-cfb3ec71debc/istio-proxy/0.log"
Oct 30 16:55:28.080125 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:28.080048    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-m4tnk_19e716a2-f834-4286-9218-0d998953696a/istio-proxy/0.log"
Oct 30 16:55:28.146827 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:28.146798    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-pvcsj_980dadce-85e0-4130-898d-9836658982ea/istio-proxy/0.log"
Oct 30 16:55:28.358860 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:28.358784    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65967fb5d5-mjwns_61601519-efc4-4541-98e5-2e61c0549970/registry/0.log"
Oct 30 16:55:28.535148 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:28.535113    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9f769b7d5-g6vn9_fcb660ae-8c6a-42ec-bd90-484b9497250b/router/0.log"
Oct 30 16:55:28.608682 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:28.608652    5101 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9s5vn_88ec9b43-75d9-4ccd-8f2a-fe417e4a9bbd/node-ca/0.log"
Oct 30 16:55:28.778334 ip-10-0-138-40 kubenswrapper[5101]: I1030 16:55:28.778299    5101 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvzgm_dbbdfeeb-7ea0-45a2-a0ba-a36cfdd65749/konnectivity-agent/0.log" limit=1024